-- Logs begin at Thu 2022-07-28 18:49:13 UTC, end at Thu 2022-07-28 20:20:54 UTC. -- Jul 28 19:49:37.181399 dv-cinder-851449-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 19:49:37.188878 dv-cinder-851449-1-smb devstack@keystone.service[80309]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 19:49:37 2022] *** Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: nodename: dv-cinder-851449-1-smb Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: machine: x86_64 Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: clock source: unix Jul 28 19:49:37.190904 dv-cinder-851449-1-smb devstack@keystone.service[80309]: pcre jit disabled Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: detected number of CPU cores: 4 Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: current working directory: / Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: detected binary path: /usr/bin/uwsgi-core Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: your processes number limit is 47680 Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: your memory page size is 4096 bytes Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: detected max file descriptor number: 2048 Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: lock engine: pthread robust mutexes Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: thunder lock: enabled Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 19:49:37.191334 dv-cinder-851449-1-smb devstack@keystone.service[80309]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 19:49:37.232218 dv-cinder-851449-1-smb devstack@keystone.service[80309]: Python main interpreter initialized at 0x55be495779c0 Jul 28 19:49:37.232218 dv-cinder-851449-1-smb devstack@keystone.service[80309]: python threads support enabled Jul 28 19:49:37.232218 dv-cinder-851449-1-smb devstack@keystone.service[80309]: your server socket listen backlog is limited to 100 connections Jul 28 19:49:37.232218 dv-cinder-851449-1-smb devstack@keystone.service[80309]: your mercy for graceful operations on workers is 90 seconds Jul 28 19:49:37.232631 dv-cinder-851449-1-smb devstack@keystone.service[80309]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 19:49:37.232707 dv-cinder-851449-1-smb devstack@keystone.service[80309]: *** Operational MODE: preforking *** Jul 28 19:49:37.232974 dv-cinder-851449-1-smb devstack@keystone.service[80309]: *** uWSGI is running in multiple interpreter mode *** Jul 28 19:49:37.232974 dv-cinder-851449-1-smb devstack@keystone.service[80309]: spawned uWSGI master process (pid: 80309) Jul 28 19:49:37.233175 dv-cinder-851449-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 19:49:37.234260 dv-cinder-851449-1-smb devstack@keystone.service[80309]: spawned uWSGI worker 1 (pid: 80312, cores: 1) Jul 28 19:49:37.234260 dv-cinder-851449-1-smb devstack@keystone.service[80309]: spawned uWSGI worker 2 (pid: 80313, cores: 1) Jul 28 19:49:37.234260 dv-cinder-851449-1-smb devstack@keystone.service[80309]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 19:49:42.760609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:42.760609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: from cryptography.utils import int_from_bytes Jul 28 19:49:42.761458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:42.761458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: from cryptography.utils import int_from_bytes Jul 28 19:49:42.762183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:42.762183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 28 19:49:42.762646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:42.762646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 28 19:49:42.811339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:49:42.811542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:49:42.811633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:49:42.811722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] command line args: [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:49:42.811795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:49:42.811965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] command line args: [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:49:42.812051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:49:42.812174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ================================================================================ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:49:42.812262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:49:42.812404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ================================================================================ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:49:42.812488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] admin_token = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.812669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.812759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] config_dir = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.812863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.812948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_dir = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] config_source = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] debug = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_source = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] debug = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.813906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.814971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_config_append = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_config_append = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_dir = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_dir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.815889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.816978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.817940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.818806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] publish_errors = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] publish_errors = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.819950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] standard_threads = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.820895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] standard_threads = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.821010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.821173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.821328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.822982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_journal = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] use_journal = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] use_json = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_json = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] use_stderr = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_stderr = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.823947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] use_syslog = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.824559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_syslog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.824677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.824796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:42.824919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.824919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.825860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.826905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.827802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.828924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.829990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.830941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.831996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.832927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.833995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.834992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.835931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.836877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.837998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.838228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.838385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.838541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.838689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.838852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.839002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.839138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.839292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.839438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.839583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.840303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.840482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.840650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.840807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.840985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.841163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.841438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.841637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.841838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.842923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.843924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.844960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.845914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.846957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.847979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.848932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.849880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.850976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.external = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.external = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.851884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.password = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.token = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.password = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.852937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] auth.token = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.853914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.854961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.855075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.855724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.855853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.855954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.856955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.857830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.858938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.859922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.860998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.861891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.862953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.863893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.864971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.865941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.866886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.867952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.868999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.869971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.870961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.871922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.872979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.873836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.874969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.875968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.876889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.877947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.878977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.879976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.880940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.881919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.882710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.883888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] role.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] role.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.884931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.885883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.886031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.886148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.886263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.886377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.886491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.887923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.888965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.889935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.890982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.891922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.892974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.893923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894170 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.894983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.895919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.896995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.897969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.898914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.899960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.900902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.901017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:49:42.901153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:42.901153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:49:42.929078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.929522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.929917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.934714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.934950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.935181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.941133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.947232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.976292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.976543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.977444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:42.977686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.031013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.031149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.081943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.082179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.082842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.083074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.147662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.147896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.147984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.148869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.149007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.173876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.174663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.185534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.185819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.198934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80313) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.199790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.200009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 19:49:43.216943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.217152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 19:49:43.217511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.217596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.217714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 19:49:43.217797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 19:49:43.217984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 19:49:43.218322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.218842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.219017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.219274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.228516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.228795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.228931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.229065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.229209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.229374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.229504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.229787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.236801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.237227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.241517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.241798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.241916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.242082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.242905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.243883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.244068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.244148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.244337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.244417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.244607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.267349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.268306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.268845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.269124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.269830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.270111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.273740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.274018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.274372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.274717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.275000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.275285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.281469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.281708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.282373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.282654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.285860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.286149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.286443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.286729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.287567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.287935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.288182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.288464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.288753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.289026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.289328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.304523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.304802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.306243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.306527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.308845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.310483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.312150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.312662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.313698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.314205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.317978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.319366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.322614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.322706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.325976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.326491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.326996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.327322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.327473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.327624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.327913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.327993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.328210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.328381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.328489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.328782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.344791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.345076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.345372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.345454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.345641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.345723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.345920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.346187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.352492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.353058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.354065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.354342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.354633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.354909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.357768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.358049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.358345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.358434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.358647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.358728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.358943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.359026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.359274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.359562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.370331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.370608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.370892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.371210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.371492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.371768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.372046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.372430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.372708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.372989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.373292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.373577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.373854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.374139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.387570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.390546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.390983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.393561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.393968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.396080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.396904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.397614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.397900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.398180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.399457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.400957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.401248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.401579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.405162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.406796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.408552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.409718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.410012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.410191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.410299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.410577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.413084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.413403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.413691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.413967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.418919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.419206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.419490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.422320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.422608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.422885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.426317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80313) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.426596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.426876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.427163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.427438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.427725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.427996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.428274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.428647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.428943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.429226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.429515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.429740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 19:49:43.429837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.430020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.430101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80313) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.430303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.430590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.430875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.431151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.431424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.431702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.432076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.432365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.432648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.432922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.433189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.433509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 19:49:43.463598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be495779c0 pid: 80313 (default app) Jul 28 19:49:43.467450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b728-60ca-430f-a6a0-399cccdc93cf None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:43.467633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be495779c0 pid: 80312 (default app) Jul 28 19:49:43.467743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b728-60ca-430f-a6a0-399cccdc93cf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:43.468023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b728-60ca-430f-a6a0-399cccdc93cf None None] PATH_INFO: `/v3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:43.472354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 19:49:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:49:51.096180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:51.096721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:51.096721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:51.101208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:49:51.106786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:51.107198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:51.107339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:51.177597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: INFO dbcounter [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] Registered counter for database keystone Jul 28 19:49:51.199436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG oslo_db.sqlalchemy.engines [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:51.205563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writer thread running {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:51.380974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG passlib.handlers.bcrypt [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80313) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 19:49:51.381426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG passlib.handlers.bcrypt [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80313) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 19:49:51.437860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:51.439389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:51.564842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 19:49:51.693603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:51.762648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: INFO dbcounter [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] Registered counter for database keystone Jul 28 19:49:51.781691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG oslo_db.sqlalchemy.engines [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:51.787797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writer thread running {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:51.906958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0b26b-422b-4a65-b6a2-c9bd7c4f5cb2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:51.911329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:51.911968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:51.912253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:51.912542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:51.922865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:51.976217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 19:49:51.976507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a3e5e-09c0-4ea9-8905-f1bfbf07acb8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:51.986249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 19:49:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 19:49:51.992181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:52.006697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd42-4841-42b0-88a1-e1d68099d42b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:52.011117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:52.012722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:52.013003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:52.013290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] PATH_INFO: `/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:52.014770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] RBAC: Authorizing `identity:get_project(project_id=7b3dbe2c1eb04d9797ed50b9b1752bfa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:52.065862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 19:49:52.066209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fac0e-3bab-4c51-8730-64ccccbd4d4b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:52.070861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 19:49:51 2022] GET /identity/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:49:54.044128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb420-232e-4bfa-94c7-29c2c42f95f9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:54.044625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb420-232e-4bfa-94c7-29c2c42f95f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:54.044726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb420-232e-4bfa-94c7-29c2c42f95f9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:54.048795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:49:54.054144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:54.054552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:54.054697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:54.074989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:54.076497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:54.084170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 19:49:54.105991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb420-232e-4bfa-94c7-29c2c42f95f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:54.117986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb420-232e-4bfa-94c7-29c2c42f95f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:54.122742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:54.123342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:54.123626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:54.123903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:54.131436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:54.133193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afda8a-fd41-48e5-b95f-822c0dffb004 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:54.141819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 19:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 19:49:54.146792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:54.155705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ca130-269f-483c-9dbe-94e69ddc0459 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:54.160070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:54.160700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:54.160987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:54.161295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:54.162660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:54.164486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb948f52-7913-4223-8372-60e16fc6fe64 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:54.166051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 19:49:54 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:49:56.191145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049fed-a301-4957-a926-e9f30676f09a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.191634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049fed-a301-4957-a926-e9f30676f09a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.191634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049fed-a301-4957-a926-e9f30676f09a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.192970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:49:56.198063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.198450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.199244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.218652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:56.219833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:56.253683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c440f-6d2c-4cd8-9006-d77f7e9fce37 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.253972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c440f-6d2c-4cd8-9006-d77f7e9fce37 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.254252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c440f-6d2c-4cd8-9006-d77f7e9fce37 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.255625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:49:56.261624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.261911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.262190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.299965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:49:56.304434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 19:49:56.304872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 19:49:56.322244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.346325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:56.351333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:56.352916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:56.426415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53521578-f8a3-4ed2-997c-476264a980ff None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:56.454502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:49:56.460067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:56.460716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.461002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.461400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.472881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:49:56.475839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:49:56.481830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:49:56.482934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:49:56.483878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:49:56.488614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.570698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:56.576192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9225eb-70fd-49a5-8920-ac76bff1043a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:56.578628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:56.593236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6b055-56b8-43d9-89cf-c38aa4f9a89b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:56.618206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:56.619457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.619840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.620226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.627413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:56.628036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.628321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.628595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.629346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:49:56.629660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:56.631061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:56.644077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:49:56.649676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.689359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:56.690919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:56.795523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:49:56.801091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.804128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:56.856241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202dcd8-7fab-47a8-a2e7-79ecaa3671c1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:56.890230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:56.890887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.891176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.891457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.892643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:56.894141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:56.895748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:49:56.901013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:56.905892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a24343-c838-4edf-b040-ef45820c36ec None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:56.919866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:56.942125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:56.942988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:56.943287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:56.943552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:56.965475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:56.966961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:49:56.985220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:49:56.986136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:49:56.986910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:49:56.986910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:49:56.986910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:49:56.986910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:49:56.986910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:49:56.992155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:57.013440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb18b8-1793-4b44-ae52-30ff5b300db6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:57.048857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:57.049469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:57.049757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:57.050036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:57.051205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:57.051434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:57.052681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:57.054402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:49:57.060667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:57.098584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae37b-d2ab-4de2-941d-721af13557cd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:57.132277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:57.132910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:57.133200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:57.133512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:57.134211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:49:57.134521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:57.135913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864514f8-8515-473a-8e5b-d95e71bad610 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:57.140866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:57.152948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:49:57.160582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e407734-e86c-4628-8788-df9d368706d2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:57.198449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:57.199227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:57.199402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:57.199678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:57.200494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.domain.id=default, user.id=cad5bc1942444b43bdd85c7ebf430c13) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:49:57.200809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:49:57.202352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f70c58-4128-427d-81ea-c6b20a9ca3f1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:49:57.210233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 19:49:57 2022] GET /identity/v3/role_assignments?user.id=cad5bc1942444b43bdd85c7ebf430c13&scope.domain.id=default&role.id=37946d08da58471c9678da91450dd183 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:49:59.491091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229babe2-1a98-4c35-aa07-ed59b5b0bc56 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.491950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229babe2-1a98-4c35-aa07-ed59b5b0bc56 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.492376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229babe2-1a98-4c35-aa07-ed59b5b0bc56 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.493952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:49:59.499056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.499788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.500240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.526423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:59.528568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:59.617472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:49:59.644808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23541519-6357-404f-8978-76eba1f36e0c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.645455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23541519-6357-404f-8978-76eba1f36e0c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.645942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23541519-6357-404f-8978-76eba1f36e0c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.647517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:49:59.649566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:59.662120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e169c8-be46-4403-9495-a80826e28575 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.662692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e169c8-be46-4403-9495-a80826e28575 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.663169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e169c8-be46-4403-9495-a80826e28575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.686380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-88e169c8-be46-4403-9495-a80826e28575 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:59.688336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-88e169c8-be46-4403-9495-a80826e28575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:59.766520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:49:59.767528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4233-b4b4-4e72-8f13-286ce9bd3c33 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.767822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4233-b4b4-4e72-8f13-286ce9bd3c33 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.768105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4233-b4b4-4e72-8f13-286ce9bd3c33 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.774427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:49:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:49:59.780092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.780550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.780973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:49:59.804304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:49:59.805909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:49:59.818766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:59.884790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:49:59.896735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:49:59.897651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:49:59.907556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbac42b-e34e-40bf-93ec-ff74783337e2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:49:59.982348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:49:59.983031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:49:59.983323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:49:59.983611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.010278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:00.016315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:00.017247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:00.018018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:00.019036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8e544-5616-4d09-a1b0-043210456a46 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.025515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 13/28] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:00.026420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.059820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.060705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.061158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.061610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.074047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.075738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:50:00.094886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:00.095905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:00.096851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:50:00.096851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:50:00.096851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:50:00.096851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:00.098469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 16/29] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:00.099394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.273711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:00.295764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068a59-1bc8-4d0e-be55-a36169168a9b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.347118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7295-33da-408d-adbc-0a83bce4cc4a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.365541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.366170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.366452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.366727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.367447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.368821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a2d3-18f6-47ed-811b-760760af61cd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.373952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:00.417825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.418431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.418798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.419081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.420068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:00.420382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.423943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.442009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 17/30] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:00.442920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.536390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 14/31] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 19:50:00 2022] POST /identity/v3/roles => generated 219 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:00.538005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97913ee-ff4b-4e2f-9c86-af671bb761e1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.538302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97913ee-ff4b-4e2f-9c86-af671bb761e1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.538586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97913ee-ff4b-4e2f-9c86-af671bb761e1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.539851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 15/32] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:00.540571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97913ee-ff4b-4e2f-9c86-af671bb761e1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.572626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:00.591706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870da-5672-4178-b3dd-46d11fc5d06e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.672560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.673217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.673526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.673962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.675935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:00.676262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.677731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6614e-c889-4e14-b141-ff21cb9eee97 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.701309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 18/33] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:00.706418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.706713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.708311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.734904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:00.736089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:00.751646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97913ee-ff4b-4e2f-9c86-af671bb761e1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.792528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.793110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.793450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.793845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.795173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.796878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.801447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 16/34] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:00 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:00.802355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.826088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:00.826893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:00.873766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:00.930451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0832f6-41ca-47bb-8aa9-9a29add14097 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.938334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:00.956599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44ab7-d3dc-430b-836b-92b91e5ae0a0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:00.968015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.968669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.968962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.969248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.969970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.971436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1a3f-6dd2-4085-818f-6937ff51af7d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:00.994837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:00.995652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:00.995950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:00.996206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:00.997657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:00.999115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.000706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 20/36] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:01.001797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:01.002484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 17/37] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:50:00 2022] POST /identity/v3/projects => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:01.003734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa968-5325-4fbd-8043-29874050b761 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.004031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa968-5325-4fbd-8043-29874050b761 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.004310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa968-5325-4fbd-8043-29874050b761 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.005579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 18/38] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:01.012712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856b7d-6fbd-42a3-ad14-21a109fb445e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.013040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856b7d-6fbd-42a3-ad14-21a109fb445e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.013309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856b7d-6fbd-42a3-ad14-21a109fb445e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.014983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 19/39] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:01.015505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856b7d-6fbd-42a3-ad14-21a109fb445e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:01.130269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a2ee-1b93-4552-a02d-255f90280099 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:01.135123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856b7d-6fbd-42a3-ad14-21a109fb445e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:01.152119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:01.172299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:01.172933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.173217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.173526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.174296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:01.175694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.177372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:01.178064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.178354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.178637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] PATH_INFO: `/v3/domains/default/users/cad5bc1942444b43bdd85c7ebf430c13/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.181976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cad5bc1942444b43bdd85c7ebf430c13, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:01.183982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831916f-347c-4f3f-b2a7-7256e4e3bdbd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.201038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 19:50:01 2022] PUT /identity/v3/domains/default/users/cad5bc1942444b43bdd85c7ebf430c13/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:01.202328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915ddb-355e-4b3c-bcbf-f0cb05793d84 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.202627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915ddb-355e-4b3c-bcbf-f0cb05793d84 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.202912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915ddb-355e-4b3c-bcbf-f0cb05793d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.223053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e8915ddb-355e-4b3c-bcbf-f0cb05793d84 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:01.224772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e8915ddb-355e-4b3c-bcbf-f0cb05793d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:01.308806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:01.309041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 19:50:01 2022] POST /identity/v3/roles => generated 225 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:01.309131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.309131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.309131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.326650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:01.327886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:01.328098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:01.350444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:01.436543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:01.460216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59454007-dfa4-4561-b15d-ae227fa867b6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:01.462570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:01.503957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:01.504467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.504758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.505043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.508157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:01.508157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.511393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 22/44] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:01.516043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:01.518281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:01.605022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9924e4-3476-4433-b792-29f4e4f834b7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:01.614401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:01.640031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede44819-eae5-4268-bfbf-7da40eb91971 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:01.646061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:01.646704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.646993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.647274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.648000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:01.649475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12ccc3-ebe1-42d3-ae9b-f77ee273b1bf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.665251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 19:50:01 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:50:01.692010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:01.692586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:01.692875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:01.693225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:01.693989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:01.695560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af271-62fe-48b7-87a7-ea5015f9440e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:01.737304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:50:01 2022] POST /identity/v3/projects => generated 312 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:50:03.230217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf7baa-529d-4cb1-86ee-ff1a9c11894b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.230715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf7baa-529d-4cb1-86ee-ff1a9c11894b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.230715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf7baa-529d-4cb1-86ee-ff1a9c11894b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.232099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:03.237479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.237863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.238157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.256789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:03.258343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:03.323196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:03.345704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf7baa-529d-4cb1-86ee-ff1a9c11894b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.442815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:03.451370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf7baa-529d-4cb1-86ee-ff1a9c11894b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:03.485460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:03.486037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.486328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.486611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.496567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:03.501587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:03.502410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:03.503213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:03.508755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.566469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:03.608452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8630d-774d-42b0-9238-57897bbc2ad7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:03.642354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:03.642986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.643278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.643562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.644291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:03.644604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:03.646018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec96d2-1586-4840-99df-46855d91f116 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:03.654193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:03.659805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.754165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183fe64-b8b0-4aba-9c93-b4b02e052b52 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.754474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183fe64-b8b0-4aba-9c93-b4b02e052b52 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.754831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183fe64-b8b0-4aba-9c93-b4b02e052b52 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.756274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 26/51] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:03.759403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3042462-21e2-4fb2-83fa-d1f106c7e8ec None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:03.761718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.762007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.762300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.780830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:03.782377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:03.796992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:03.797689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.797975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.798257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.799450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:03.800884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:03.802518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:03.807825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.832313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:03.850570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:03.872960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.911482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a15cd-ef44-4269-98db-7bf83a956ac8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:03.925277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:03.944658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:03.945324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:03.945612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:03.945890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:03.947042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:03.949036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:03.950660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:03.956266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:03.975876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bbbd0-0ce4-472a-937d-4e9668b94cad None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:04.008546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461430-c137-421e-9091-d49c632319df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:04.009132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461430-c137-421e-9091-d49c632319df None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:04.009453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461430-c137-421e-9091-d49c632319df None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:04.009736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4461430-c137-421e-9091-d49c632319df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:04.011429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461430-c137-421e-9091-d49c632319df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:04.012906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4461430-c137-421e-9091-d49c632319df None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:04.014539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:04.019999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461430-c137-421e-9091-d49c632319df None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:04.046136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:04.056006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d246e66-0fcb-4559-8db8-438e48a26ef0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:04.090361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:04.091011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:04.091298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:04.091575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:04.092363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.domain.id=default, user.id=cad5bc1942444b43bdd85c7ebf430c13) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:04.092675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:04.094158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dd500-f9f6-4707-8d51-6b8ba65c2e3b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:04.099951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 19:50:03 2022] GET /identity/v3/role_assignments?user.id=cad5bc1942444b43bdd85c7ebf430c13&scope.domain.id=default&role.id=37946d08da58471c9678da91450dd183 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:04.122218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4461430-c137-421e-9091-d49c632319df None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:04.141209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:04.160072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:04.160725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:04.161016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:04.161324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:04.162036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:04.163536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35112c9-3cb6-4da7-bf7d-8575101517ac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:04.191782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 19:50:04 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:50:06.195111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66716-75b8-4316-91c8-36e77d609287 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:06.195591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66716-75b8-4316-91c8-36e77d609287 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:06.195591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66716-75b8-4316-91c8-36e77d609287 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:06.196930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:06.202096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:06.202506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:06.202664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:06.220297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:06.221529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:06.285465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:06.310219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf66716-75b8-4316-91c8-36e77d609287 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:06.411170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf66716-75b8-4316-91c8-36e77d609287 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:06.443558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:06.444184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:06.444466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:06.444739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:06.445964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:06.447347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667ddd-ec26-47c7-acca-749c205c1228 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:06.448977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:06.454451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:06.550426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:06.553387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed2c7f-ac64-44a7-8009-9e9665c59367 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:06.587773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:06.588392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:06.588682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:06.588964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:06.589754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:06.591208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591a8b5-d773-47a0-991a-dabd611c7240 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:06.616596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:06 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:09.716918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a2ac6-4571-40de-8970-3b5f6943df39 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:09.717960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a2ac6-4571-40de-8970-3b5f6943df39 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:09.718475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a2ac6-4571-40de-8970-3b5f6943df39 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:09.720045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:09.725125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:09.725943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:09.726423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:09.734595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a94b1-b6d0-478d-9c8a-2d7b4f3faef3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:09.735139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a94b1-b6d0-478d-9c8a-2d7b4f3faef3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:09.735618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a94b1-b6d0-478d-9c8a-2d7b4f3faef3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:09.737413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:09.751399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:09.751992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:09.752467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:09.756241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:09.758026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:09.782066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:09.784883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:09.818804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:09.894270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 32/64] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:09.912812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 33/65] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:09.935778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:09.946834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.057862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.075011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3abd8-7dc1-4c4d-8ae7-195998808063 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.106510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a06ae-a0ab-416c-8d05-abf4f1bc2fdc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.111111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.111961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.112389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.112816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.128054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9d454491-2b6c-46db-a953-a832b06ab650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:10.135139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:10.136688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:10.137531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:10.139377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 33/66] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:10.140710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d951d1-dfcc-4413-bff9-22b388217abd None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.141185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d951d1-dfcc-4413-bff9-22b388217abd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.141664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d951d1-dfcc-4413-bff9-22b388217abd None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.143096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 34/67] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:10.148089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d951d1-dfcc-4413-bff9-22b388217abd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.149592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.150488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.150962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.151458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.162261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d6c204c4-2a9d-4bae-a8e4-2e16516ad660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:10.167939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:10.168728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:10.169503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:10.176729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 34/68] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:10.178281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.178779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.179290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.198375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:10.199896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:10.218595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.264900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d951d1-dfcc-4413-bff9-22b388217abd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.271389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:10.272237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.309092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.309671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.309960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.310242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.310961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:10.311270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.312674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e34f5-e42c-4589-a598-5c7084ca46e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.320956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:10.322143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708052-19b4-42df-babf-78bd01557ff7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.322433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708052-19b4-42df-babf-78bd01557ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.322715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44708052-19b4-42df-babf-78bd01557ff7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.324130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 36/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:10.328879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613909ae-4168-40e6-a8db-8291c4c90918 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.329174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613909ae-4168-40e6-a8db-8291c4c90918 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.329482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613909ae-4168-40e6-a8db-8291c4c90918 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.330707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 37/72] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:10.331409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613909ae-4168-40e6-a8db-8291c4c90918 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.342390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.376485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9137e-89cf-4ab9-a6c2-cb487c3cd245 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.411025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.411662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.411950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.412230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.412953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:10.413286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.414694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.424554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:10.425566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.429175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.438785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613909ae-4168-40e6-a8db-8291c4c90918 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.473018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.473692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.473982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.474264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.484718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8b537441-8e47-4af1-adcf-8095e9be5ab3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:10.489673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:10.490499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:10.496967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.497866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.497866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.511869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:10.513373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:10.527745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99775d8f-ba54-4000-908a-e8c7ea8e96d5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.562178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.562762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.563053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.563345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.564534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.566007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c06d-218f-4982-b52f-1fc682509998 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.567614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:10.568725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.569014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.569305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.575841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.582322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 39/76] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:10.583212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.598464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:10.599657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:10.667340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:10.668249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.670482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.687499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa932-9c57-4bcb-91ac-461fcd92ef5d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.721081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.721763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.722055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.722338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.737667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.739124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.740909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:10.741638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.775278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa641-b150-4af6-a0c2-f62039f3d7d8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.796406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.811152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.811978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.812543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.812996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.814301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:10.814796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.816219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.826644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:10.827470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:10.849757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afda014-16b7-4d45-bc33-ff9af20c6b0b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.885549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.886697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.886986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.887267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.892840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:10.931970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87cd4-ab9d-446c-9c8e-79c29d181782 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:10.959061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:10.960551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:10.965911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:10.966558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:10.966849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:10.967132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:10.978008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:10.983445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:10.984460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:10.985211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 40/80] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:10.985871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.019424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.063689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 41/81] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:11.066130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.085554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad597-9095-4a38-a79d-26ba34eab46d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.108298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.119007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.119654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.120445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.120725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.121903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.123371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.124964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 41/82] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.130193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.164212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9f465-8912-4bc5-b38a-d5f8f3af3a0a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.199577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.200200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.200520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.200795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.228586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.236495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25162e14-63f0-46b1-8a72-dd16579dd67b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.271511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.272164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.272449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.272732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.273640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.273919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.275118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.275371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.277008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.277805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.334746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.376708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6da2a8-e5d4-48df-9507-b67f9e2376ca None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.377839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 42/84] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:11.378687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.410887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608495-3975-4601-84b9-0ca725904669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.411503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608495-3975-4601-84b9-0ca725904669 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.411787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608495-3975-4601-84b9-0ca725904669 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.412066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608495-3975-4601-84b9-0ca725904669 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.412780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608495-3975-4601-84b9-0ca725904669 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:11.413089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608495-3975-4601-84b9-0ca725904669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.414592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608495-3975-4601-84b9-0ca725904669 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.423337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.424103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608495-3975-4601-84b9-0ca725904669 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.440530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.484117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49752f4-58db-4f1e-a10d-f15811758989 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.518228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.518868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.519151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.519427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.520550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608495-3975-4601-84b9-0ca725904669 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.520653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.522024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.523763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 43/86] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.524524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.546422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.558548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.559175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.559467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.559747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.560435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.561915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.587517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 44/87] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:11 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:11.594503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.629755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c700df-584d-4a4c-8c85-0f290ad81404 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.656270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.669407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.670063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.670353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.670688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.714110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf171d4-8a68-4b73-a33d-59ed034370a8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.743080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.744810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.753610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.754273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.754557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.754832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.756600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.758093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.759775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 45/88] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.760582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.822112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.861813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:11.863123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.893216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:11.904566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a251-00e8-4cba-be1f-c77a30191135 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:11.954570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:11.956097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:11.956560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:11.957423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:11.959383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:11.961036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:11.962738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 46/90] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:11.963615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:11.989110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1bf94-d691-4cde-bdce-cb4747d2228b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.030888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.031516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.031799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.032078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.032942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=cad5bc1942444b43bdd85c7ebf430c13) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:12.033257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.034868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.044685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 45/91] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/role_assignments?user.id=cad5bc1942444b43bdd85c7ebf430c13&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:12.045561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:12.133690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6697f-b17e-4047-88b5-3b1277c39133 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.162571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:12.186252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:12.200092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ca11-83e4-45ab-be41-8615f951ac75 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.200675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.201344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.201636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.202025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.202944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:12.203267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.204741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.211398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:11 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:12.212285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:12.288328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.289068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.289384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.289669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.291273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.293407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.304624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 46/93] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:12 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:12.311793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:12.421421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec98d-3f32-4a44-9240-219d6848bba9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.485474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.486119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.486408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.486690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.509538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd9bb-a539-4e02-bbee-9de2b7e903ba None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.570739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:12.575185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.575825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.576115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.576398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.577210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:12.577552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.580374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.595472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 47/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:12 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:12.623634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.625217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.762894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 48/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:12.768663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:12.804977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:12.897775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c14f5a-4576-4582-9135-759e2e0aa1e3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:12.935480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:12.936150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:12.936436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:12.936718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] PATH_INFO: `/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:12.937918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] RBAC: Authorizing `identity:get_project(project_id=55caed42d5ed4ad69b5a83f70a8d1607)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:12.939388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099411e-94aa-4c6d-ae95-2610680810ad None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:12.941070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:12 2022] GET /identity/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:12.947399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:13.085187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:13.114347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7aa8-ce1f-41d4-a955-a1933e7b2850 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:13.170665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:13.171304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:13.171593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:13.171878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:13.172687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=55caed42d5ed4ad69b5a83f70a8d1607, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:13.173005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:13.178578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dda72e-3adc-405f-86d9-85546b21cc1f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:13.185245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:12 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=55caed42d5ed4ad69b5a83f70a8d1607&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:14.333994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b2ad-e62e-4b14-aecd-5e7088cb139c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.334465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b2ad-e62e-4b14-aecd-5e7088cb139c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.334536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308b2ad-e62e-4b14-aecd-5e7088cb139c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.336079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:14.342057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.342446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.342628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.370812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:14.372204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:14.465139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:14.507923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b2ad-e62e-4b14-aecd-5e7088cb139c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:14.611305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:14.624283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308b2ad-e62e-4b14-aecd-5e7088cb139c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:14.658888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:14.659541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.659832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.660116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.661253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:14.662742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac13fb-695d-405f-be0b-d90f154940eb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:14.664794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 50/100] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:14.672743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:14.820192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:14.850669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42f6ac-2700-4d9d-8dc1-aa52ca3cc746 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:14.894015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:14.894653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.894935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.895213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.895908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:14.897407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa03d2-8ef3-4bef-bddc-50669eb4f124 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:14.927933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 51/101] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:50:14 2022] POST /identity/v3/projects => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:14.957335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb5998-11b7-4d87-8821-32b988c45f31 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.957659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb5998-11b7-4d87-8821-32b988c45f31 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.957918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb5998-11b7-4d87-8821-32b988c45f31 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.959323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 51/102] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:14.964134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1fc3-7c93-4b65-b41e-0a062dbcfa68 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.964428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1fc3-7c93-4b65-b41e-0a062dbcfa68 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.964712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1fc3-7c93-4b65-b41e-0a062dbcfa68 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.966194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 52/103] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:14.967918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.968209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.968495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:14.985203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bba3-1c8a-4a88-868a-b9ba33976f90 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:14.985527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bba3-1c8a-4a88-868a-b9ba33976f90 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:14.985818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9bba3-1c8a-4a88-868a-b9ba33976f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.005194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:15.006472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:15.021093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-55e9bba3-1c8a-4a88-868a-b9ba33976f90 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:15.022347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-55e9bba3-1c8a-4a88-868a-b9ba33976f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:15.098009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 52/104] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:15.126783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.210795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 53/105] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:15.212127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354a14-aab8-4f85-9898-21b31d078a23 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.212420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354a14-aab8-4f85-9898-21b31d078a23 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.212701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94354a14-aab8-4f85-9898-21b31d078a23 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.214768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 54/106] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:15.220270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.220555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.220837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.240585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:15.242167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.243011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:15.262108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f854-6c0a-4917-9f15-c2c99404926f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.312876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.313356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.314907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.315335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.315780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.332240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:15.334679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 55/107] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:15.337948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:15.339822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:15.340764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:15.342232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.343445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 53/108] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:15.351400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.481339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bd7d-90a8-4239-a8c0-e654b4abb162 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.499346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd1ebd-94f8-45b7-8d62-b488435802c6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.521420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.522309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.522742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.523166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.535823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:15.538983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.539630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.539910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.540196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.541178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:15.542075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:15.543379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:15.544194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:15.544928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:15.545497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:15.547493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 56/109] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:15.548505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.552621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 54/110] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:15.557780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.568899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.603426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.662537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41e17-d44a-4f59-ad23-32871cc67aef None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.700373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.701474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.701962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.702468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.714593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:15.720142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:15.720965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:15.721736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:15.724177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 57/111] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:15.725166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.765872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d4f5-3c3a-4247-804b-45a2f615a2ee None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.800993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.801731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.801833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.802095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.803091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:15.803405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:15.804790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:15.816876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 55/112] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:15.816876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.886315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.894929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e68b-e596-4605-99fe-f6f67b1f52fc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.917759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:15.920312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf8ea-8549-4aee-9f41-1bf69b42ff53 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:15.955185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.955827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.956120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.956404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.957237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:15.957583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:15.959093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:15.965248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:15.965931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:15.966221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:15.966505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] PATH_INFO: `/v3/users/dc461dbe03074dc3b0c37f978624c223` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:15.968351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 56/113] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:15.969168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:15.987523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] RBAC: Authorizing `identity:get_user(user_id=dc461dbe03074dc3b0c37f978624c223)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:15.989031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:15.995267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 58/114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/users/dc461dbe03074dc3b0c37f978624c223 => generated 289 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:15.996110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.082162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bf7a-6026-4a1d-8a9c-3c4b9746a497 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.120119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.126663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.127584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.127876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.128155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.129823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.131306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.132964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 57/115] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:16.133789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.144034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384da4-42ea-4fd9-ae68-d97bea828d78 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.186793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.187446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.187841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.188176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.189651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.191303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42357b-de79-4e9b-8e9b-fea2db0c0a5b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.193141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 59/116] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:15 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:16.194510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d6b6-a2c5-4d64-a352-10d90edda0fa None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.194796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d6b6-a2c5-4d64-a352-10d90edda0fa None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.195250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d6b6-a2c5-4d64-a352-10d90edda0fa None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.196581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 60/117] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:16.201315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469330-5d67-45b8-8c5a-9c026cbc8520 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.201315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469330-5d67-45b8-8c5a-9c026cbc8520 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.201315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18469330-5d67-45b8-8c5a-9c026cbc8520 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.203673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 61/118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:16.207756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18469330-5d67-45b8-8c5a-9c026cbc8520 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.239473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.244772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4dd10-e858-44d8-97ea-f8d958231e00 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.280791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.281475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.281766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.282049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.317004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18469330-5d67-45b8-8c5a-9c026cbc8520 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.350824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.354567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.355494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.356152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.356315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a480b-7629-4e94-8338-d14e8f4f1a49 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.356700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.356984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.358422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.360033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.361894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 62/119] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:16.362501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.470106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.474288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dac68-4bb7-4573-a272-b3e56ed40117 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.474530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 58/120] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:16.475790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.476083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.476369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.494464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:16.495811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:16.514420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.515340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.515665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.515922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.517155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.518650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f74af-106f-4754-831a-302025b80a50 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.520517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 63/121] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:16.525310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.525310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.525310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.541151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:16.542404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:16.571933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 59/122] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:16.573337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.611377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.633611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 64/123] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:16.634794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.699354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4dfb-d2ed-4a36-8bd2-af67790b3a1e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.735353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.736035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.736328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.736610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/users/cad5bc1942444b43bdd85c7ebf430c13/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.738587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, user_id=cad5bc1942444b43bdd85c7ebf430c13, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.740039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.742065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.749817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08bb8-425c-4827-b664-718a9540f283 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.755246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 60/124] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:16 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/users/cad5bc1942444b43bdd85c7ebf430c13/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:16.755831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.817132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.818785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.819589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.820130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.822425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.824842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.827947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 65/125] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:16.829121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.886670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:16.899288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e60d9-ef2a-4a1d-9607-9db817bf64eb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.942403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.943086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.943374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.943655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/users/3ffbe36b8a094832848477282e31103c/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:16.946476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, user_id=3ffbe36b8a094832848477282e31103c, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:16.947278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e8a96-4f7f-40cc-948a-f1c0e8be4d6b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:16.948531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:16.962683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 61/126] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:16 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/users/3ffbe36b8a094832848477282e31103c/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:16.963770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:16.991553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:16.992308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:16.992983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:16.992983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.006644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:17.012136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:17.013017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:17.013792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 66/127] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:17.014391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.054857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:17.151376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630da9-e972-4fc0-a7e1-899e808bec41 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.192126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0868-0bab-40aa-bf1e-3238e713514e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.195911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.196550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.196832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.197104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.197988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=dc461dbe03074dc3b0c37f978624c223) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:17.198302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.199832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.210888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 67/128] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/role_assignments?user.id=dc461dbe03074dc3b0c37f978624c223&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.210888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.271516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.272577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.273065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.273569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.303493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:17.310052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:17.310890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:17.311622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:17.314351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 62/129] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:17.319923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.322768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:17.338645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1170c-2b6d-4177-835f-a3d3a4410dcb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.344762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:17.388000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.388904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.391652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.392074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.392863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:17.393176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.396817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.423744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 68/130] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.429568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.485886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08418ae-758f-4714-bfa6-7503c4e2695a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.539347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.539990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.540278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.540557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.542126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:17.542434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.543825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ff2e-745d-473c-9c18-461f082c52ea None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.560350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 63/131] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.563147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dc17-15d4-4286-a60c-c15308a50a75 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.563439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dc17-15d4-4286-a60c-c15308a50a75 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.563717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dc17-15d4-4286-a60c-c15308a50a75 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.565342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 64/132] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:17.566981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dc17-15d4-4286-a60c-c15308a50a75 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.576630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a7e2b-89c2-4ba3-beaf-bddc823d1683 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.612522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.613463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.613892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.614331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.615723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.617459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365727-36cd-43ac-8163-30c6e209465e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.619292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 69/133] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:17.620753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8264-b180-4865-b298-fda200f6126f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.621229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8264-b180-4865-b298-fda200f6126f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.621670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8264-b180-4865-b298-fda200f6126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.639981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-effd8264-b180-4865-b298-fda200f6126f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:17.641479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-effd8264-b180-4865-b298-fda200f6126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:17.656460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:17.712613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 70/134] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:17.714905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8264-b180-4865-b298-fda200f6126f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.739566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:17.779711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dc17-15d4-4286-a60c-c15308a50a75 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.822458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.823185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.823476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.823759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.825083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.826584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.832294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 65/135] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.832929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.839436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8264-b180-4865-b298-fda200f6126f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.940371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7341-5dfe-4b98-b1a9-866983564833 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:17.973825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.974006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:17.974399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.974687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:17.974777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.974963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.975067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:17.975250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] PATH_INFO: `/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:17.976111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.977585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.981977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] RBAC: Authorizing `identity:get_project(project_id=55caed42d5ed4ad69b5a83f70a8d1607)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:17.983451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:17.984616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 66/136] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.985498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.985598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 71/137] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607 => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:17.987045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:17.997626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:18.049746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:18.094362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8c98-1880-4b97-b612-b6736e88fb4e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:18.131511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:18.132255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:18.132545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:18.132823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:18.134051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:18.136656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:18.138717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 67/138] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:17 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:18.139373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:18.225396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:18.249349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3fb-2e4e-414f-bffa-66ffca3ff700 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:18.263033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed56d-e6d4-4959-814f-11f9e79836ab None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:18.284681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:18.285411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:18.285702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:18.285982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] PATH_INFO: `/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607/users/3ffbe36b8a094832848477282e31103c/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:18.287970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] RBAC: Authorizing `identity:create_grant(project_id=55caed42d5ed4ad69b5a83f70a8d1607, user_id=3ffbe36b8a094832848477282e31103c, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:18.289495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:18.305147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 68/139] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:18 2022] PUT /identity/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607/users/3ffbe36b8a094832848477282e31103c/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:18.306121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:18.343336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:18.344161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:18.344490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:18.344824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:18.345756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:18.347507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87213ed-3790-4bb2-afa9-f3af8a341cf7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:18.389623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 72/140] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:17 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:18.433199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5da990-445d-41dc-97af-7cbbc7007111 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:18.472116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:18.472812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:18.473097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:18.473419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/users/3ffbe36b8a094832848477282e31103c/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:18.475878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, user_id=3ffbe36b8a094832848477282e31103c, role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:18.477436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bed65-2ac7-4ef5-87b9-1fa2e0c86036 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:18.481064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:18.496036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:18 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/users/3ffbe36b8a094832848477282e31103c/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:19.418903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e990-3e08-4f7e-b3ca-76c2b7f41701 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:19.419977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e990-3e08-4f7e-b3ca-76c2b7f41701 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:19.420476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e990-3e08-4f7e-b3ca-76c2b7f41701 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:19.422416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 73/142] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:19.429849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:19.430462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:19.430964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:19.452686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:19.454307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:19.530784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:19.554024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56e990-3e08-4f7e-b3ca-76c2b7f41701 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:19.637914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:19.674300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56e990-3e08-4f7e-b3ca-76c2b7f41701 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:19.717439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:19.718455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:19.718947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:19.719432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:19.735786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:19.741449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:19.742290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:19.743058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:19.746258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 74/144] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:19.751917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:19.877139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039a7a9-c6c0-46bf-bf68-334ca67204a1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:19.921185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:19.930725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:19.932310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:19.932945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:19.933458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:19.934401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:19.934912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:19.936559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:19.946247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 71/145] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:19.951478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:20.068622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf33707-c016-49bf-a8bb-c4cac41dae4c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:20.118201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:20.123966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:20.124629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.124916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.125277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] PATH_INFO: `/v3/users/cad5bc1942444b43bdd85c7ebf430c13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.126496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] RBAC: Authorizing `identity:get_user(user_id=cad5bc1942444b43bdd85c7ebf430c13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:20.128392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3882f3-21ae-49d3-92a9-040d957bbabf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:20.130588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 75/146] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:19 2022] GET /identity/v3/users/cad5bc1942444b43bdd85c7ebf430c13 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:20.136668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:20.231685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e9e7-ca3c-4f77-a35c-32236003e642 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.231980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e9e7-ca3c-4f77-a35c-32236003e642 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.232169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e9e7-ca3c-4f77-a35c-32236003e642 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.233563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 76/147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:20.252751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508fe27-9847-423a-82bb-19f42049ed25 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.253076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508fe27-9847-423a-82bb-19f42049ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.253614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508fe27-9847-423a-82bb-19f42049ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.291860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9a9d-cad1-4917-b40d-378115182f14 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:20.296087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d508fe27-9847-423a-82bb-19f42049ed25 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:20.297336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d508fe27-9847-423a-82bb-19f42049ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:20.373514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:20.374158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.374460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.374743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.470689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 77/148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:20.472024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d5de-13b2-46c9-9fa7-e5ffc76abbf3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.472319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d5de-13b2-46c9-9fa7-e5ffc76abbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.472602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d5de-13b2-46c9-9fa7-e5ffc76abbf3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.477832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 78/149] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:20.483269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b100-0415-479c-ad17-d246021eab13 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.483502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b100-0415-479c-ad17-d246021eab13 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.483783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b100-0415-479c-ad17-d246021eab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.516334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:20.523649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5589b100-0415-479c-ad17-d246021eab13 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:20.525080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5589b100-0415-479c-ad17-d246021eab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:20.566158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:20.567664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:20.639049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 79/150] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:20.639975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b100-0415-479c-ad17-d246021eab13 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:20.729657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:20.782780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b100-0415-479c-ad17-d246021eab13 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:20.835841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:20.836517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:20.836808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:20.837086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:20.854923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:20.868005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:20.868877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:20.870208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 80/151] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:20.870836 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:20.975888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 72/152] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:20.976841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.027170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c83b37-e67a-4261-9163-0cc01870752d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.069404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:21.102333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.103350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.104369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.104844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.130159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:21.135556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:21.136359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:21.137082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:21.139390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 81/153] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:21.140383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.187321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:21.213299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a931-0551-4d79-9c98-39b386c690f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.274014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.274657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.274951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.275234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.275993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:21.276303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:21.277722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:21.298085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 73/154] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:21.298085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.346713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3940-9a0c-45b4-9306-151f501ce7bb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.436680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.437379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.437673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.437955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.442029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:21.443524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:21.448544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 82/155] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:21.450581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.579871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:21.611511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426d5d7-f037-4000-a270-39b576149463 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.678971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.679971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.680452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.680921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.681914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:21.682466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:21.684085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:21.704477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 74/156] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:21.705705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.721295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b588b43-edd7-467e-ad19-30088f619e4b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.730542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:21.865317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a591d05-195d-4c8e-952d-a48346ee5f14 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:21.889647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.890317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.890605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.890886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.893996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:21.895480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:21.897339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 83/157] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:21.898471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:21.945484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:21.946416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.946849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.947273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.948288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=cad5bc1942444b43bdd85c7ebf430c13) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:21.948759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:21.950398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffbb06-d12b-45cc-bb82-30b68b2292dc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:21.963934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 75/158] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/role_assignments?user.id=cad5bc1942444b43bdd85c7ebf430c13&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:21.965716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de48f-4a71-468c-b1e9-da7c139ffcee None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:21.966293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de48f-4a71-468c-b1e9-da7c139ffcee None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:21.966736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341de48f-4a71-468c-b1e9-da7c139ffcee None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:21.968593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 76/159] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:21.969695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de48f-4a71-468c-b1e9-da7c139ffcee None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:22.068465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9192f-0487-4ef8-b2d2-69774ded89ed None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.105779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.151870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.152468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.152754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.153034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] PATH_INFO: `/v3/users/dc461dbe03074dc3b0c37f978624c223` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.158110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] RBAC: Authorizing `identity:get_user(user_id=dc461dbe03074dc3b0c37f978624c223)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:22.159862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1edd0e-478a-4d0d-bc9f-8ba87a7be381 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:22.161780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 84/160] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/users/dc461dbe03074dc3b0c37f978624c223 => generated 289 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:22.163308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88541-85b2-4bb9-9d45-0d255ee51af6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.163734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88541-85b2-4bb9-9d45-0d255ee51af6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.164163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88541-85b2-4bb9-9d45-0d255ee51af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.172347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.214574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-38e88541-85b2-4bb9-9d45-0d255ee51af6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:22.215809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-38e88541-85b2-4bb9-9d45-0d255ee51af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:22.231123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341de48f-4a71-468c-b1e9-da7c139ffcee None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.310585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.311232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.311530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.311818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.320610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 85/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:22.322246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ebcde-49c6-428d-98b9-d354873e2eb0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.322762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ebcde-49c6-428d-98b9-d354873e2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.323296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ebcde-49c6-428d-98b9-d354873e2eb0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.332114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 86/162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:22.333172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ebcde-49c6-428d-98b9-d354873e2eb0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:22.431982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:22.433720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:22.475093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ebcde-49c6-428d-98b9-d354873e2eb0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.491167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.514462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.515460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.516065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.516560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.518342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.518590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:22.521185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b43767-aae3-45b8-b65a-702a18f676ae None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:22.524210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 87/163] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:22 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:22.526332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c92e0-3308-4c64-b8de-ae174a2ca2ab None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.526841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c92e0-3308-4c64-b8de-ae174a2ca2ab None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.527323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c92e0-3308-4c64-b8de-ae174a2ca2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.548442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-645c92e0-3308-4c64-b8de-ae174a2ca2ab None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:22.550013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-645c92e0-3308-4c64-b8de-ae174a2ca2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:22.551114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 77/164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:22.551977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:22.626040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 88/165] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:22.628237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b609-586d-4376-af28-6f4cedaa1b03 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.628739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b609-586d-4376-af28-6f4cedaa1b03 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.629242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074b609-586d-4376-af28-6f4cedaa1b03 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.630751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 89/166] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:22.631624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074b609-586d-4376-af28-6f4cedaa1b03 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:22.660028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97d8c-1e8c-41f3-b622-4fbcd395c476 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.697858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.698473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.698939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.699359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.710890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:22.716327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:22.717177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:22.718145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:22.720922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 78/167] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:22.721905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:22.754784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074b609-586d-4376-af28-6f4cedaa1b03 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.771441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.774256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:22.801698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.802777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.803553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.803989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/users/dc461dbe03074dc3b0c37f978624c223/roles/49ad12f713384bd298c9e1a3de23d6e7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.807422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, user_id=dc461dbe03074dc3b0c37f978624c223, role_id=49ad12f713384bd298c9e1a3de23d6e7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:22.809484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b7716-2318-4e92-9d6c-ad0571dd1599 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:22.829135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 90/168] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:22 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/users/dc461dbe03074dc3b0c37f978624c223/roles/49ad12f713384bd298c9e1a3de23d6e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:22.837768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.837768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.837768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.875732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:22.878464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:22.881419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8fe6-794a-4f7f-b474-437af985cb38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:22.953488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:22.954074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:22.954353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:22.954627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:22.957238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:22.959697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:22.966663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 79/169] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:22 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:22.967333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.023104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 91/170] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:23.024271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.099821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b567f6c-58dd-4ab3-9103-2e740743d9bd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.103227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.140238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.140996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.141297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.141651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.143688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374b852-1663-4fd4-ab44-345c29f8b198 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.145223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.154209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:23.159162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:23.160222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:23.161020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 80/171] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:23.161736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.190188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.191068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.191493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.191927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.192821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:23.193305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.194693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58d11-6e05-44e0-a364-1ed5d5659911 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 92/172] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282283f-a42a-46b4-a92a-17eac716297a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282283f-a42a-46b4-a92a-17eac716297a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282283f-a42a-46b4-a92a-17eac716297a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 93/173] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:23.208482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282283f-a42a-46b4-a92a-17eac716297a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.272590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d3d2-77f7-4152-af02-3718062ab9d0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.309790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.310413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.310701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.310980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.311787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:23.312120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.313590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b05b5f-38b4-4f17-afaf-e043b1bda723 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.320085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 81/174] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.321248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7c75-6d9a-4ff8-a571-96c751c31003 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.321570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7c75-6d9a-4ff8-a571-96c751c31003 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.321850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7c75-6d9a-4ff8-a571-96c751c31003 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.323268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 82/175] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:23.323902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7c75-6d9a-4ff8-a571-96c751c31003 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.336220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282283f-a42a-46b4-a92a-17eac716297a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.359879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.392003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.392782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.393144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.393646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.406488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:23.412080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:23.413202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:23.414214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:23.414819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 94/176] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:23.420883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.455800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.472591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7c75-6d9a-4ff8-a571-96c751c31003 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.513375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.514017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.514303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.514647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.515425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:23.515623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.517019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18e893-b457-4f6c-acb8-68f59c26815c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.528386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 83/177] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.529786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.530076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.530357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.554083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:23.555290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:23.566695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78907a-316c-4e83-b03b-242113ae8a82 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.605178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.605898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.606168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.606445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.607632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.609098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09f97-883e-4e72-b8c0-9b29c509f444 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.611963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 95/178] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.612910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.613185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.613510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.633467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 84/179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:23.633648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:23.634260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.634662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:23.663309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.710015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 96/180] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:23.710782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.736590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.759442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87f499-80cb-4aa6-9198-9a8c07701f63 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.795561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.796187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.796477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.796757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.797529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:23.797848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.799221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.807515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 85/181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.808303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.827236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d965a8-ece7-4715-860c-fe86564f4240 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.865860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.866509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.866793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.867069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] PATH_INFO: `/v3/users/3ffbe36b8a094832848477282e31103c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.868244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] RBAC: Authorizing `identity:get_user(user_id=3ffbe36b8a094832848477282e31103c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:23.869807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:23.871410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 97/182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/users/3ffbe36b8a094832848477282e31103c => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:23.872179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:23.914985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.935322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1511ac-0d92-4536-b830-c7c69c63f2ee None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:23.969103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:23.970585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:23.971369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:23.971708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:23.972003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:23.982297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198114a4-8988-4899-9e8b-b7c11f162702 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.020916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.021862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.022312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.022734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.024031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.026298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.028205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 98/183] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:24.028983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.049225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.051351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.139129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.145784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3f7c-0762-46db-8715-75d42d921236 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.161789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 86/184] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:24.162874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.186676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.187325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.187609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.187885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.198811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:24.204160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:24.205003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:24.205779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 99/185] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:24.206393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.229654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.269311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23d5f3-1785-48e8-8d02-94000dc9dfd0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.310029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.310630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.310915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.311193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.320331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7f81-3329-4daa-b414-7dfb90f98990 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.325066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.326564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.328202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 87/186] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:24.330515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.359904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.360896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.361250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.361545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.380999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.437426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.438894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.444749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc386f9-d8c4-47e2-8163-cdafe0539900 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.458846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.479648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.480272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.480558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.480838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.481561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.483020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.504163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 88/187] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:24 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:24.505391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.590359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 100/188] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:24.591705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.649471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.661894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26719e-3269-4b6e-be37-b71474abbc24 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.700827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.701495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.701788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.702061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] PATH_INFO: `/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.703213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] RBAC: Authorizing `identity:get_project(project_id=55caed42d5ed4ad69b5a83f70a8d1607)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.704646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.706519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 89/189] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/projects/55caed42d5ed4ad69b5a83f70a8d1607 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:24.710036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.727036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df80247-c8e0-44ff-afb2-034cc48eeb41 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.749185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.770925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.771617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.771904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.772184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.772967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:24.773352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.774842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.785518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 101/190] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:24.785518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.845443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192dca-d666-46c7-baae-6772edea00c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.896189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.896818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.897104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.897426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.916591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962302-f207-4c29-b2c8-52979f88c21a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:24.931194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:24.958368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:24.959386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:24.959870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:24.960826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:24.962593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.964813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:24.967682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 102/191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:24.968612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:24.984898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:24.987097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.037345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.106354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1afc2-996d-4b5d-81c4-852cd57d55d2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.112100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 90/192] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:25.113194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.142761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.143389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.143673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.143949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.144751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=55caed42d5ed4ad69b5a83f70a8d1607, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:25.145069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.146575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.152956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 103/193] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:24 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=55caed42d5ed4ad69b5a83f70a8d1607&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:25.153806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.220424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.297585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e463-3ec4-4e09-bc4d-062cc9b7434e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.355129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.355795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.356085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.356421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.357591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.359037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d0200-ae29-45ec-a603-339b94bd2171 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.361053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9044-69c6-4a04-adb5-a4d4d5be355b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.365298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 91/194] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:25.366757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bc093-535f-461f-a855-71d89f6578ca None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.367048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bc093-535f-461f-a855-71d89f6578ca None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.367330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bc093-535f-461f-a855-71d89f6578ca None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.368904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 92/195] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:25.369723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bc093-535f-461f-a855-71d89f6578ca None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.389624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.406189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.406841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.408360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.408641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.409869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=3ffbe36b8a094832848477282e31103c) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:25.410197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.411845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.419450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 104/196] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/role_assignments?user.id=3ffbe36b8a094832848477282e31103c&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:25.420297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.562282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bc093-535f-461f-a855-71d89f6578ca None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.621779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.629465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0e4f0-86ac-4e6d-b87b-5fca1bf84406 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.631434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.632210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.632497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.632779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.634002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.636036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8cbdd-cdf3-4a97-91bd-bafe942f6b26 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.637999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 93/197] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:25.644241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.644536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.644918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.667468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.667793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:25.668107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.668394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.668673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.668966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:25.723773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.746579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 94/198] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:25.747662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.764764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.766292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.871857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b6ddf-b4e5-4851-83a1-3b8731f16abe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:25.900797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:25.907339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:25.907963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:25.908249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:25.908531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:25.909360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=116381016511423d811c369b96ef019b, user.id=2634f15320534b378968dc5fdd4e0cfb) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:25.909679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:25.911134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:25.921297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 95/200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/role_assignments?user.id=2634f15320534b378968dc5fdd4e0cfb&scope.project.id=116381016511423d811c369b96ef019b&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:25.921297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:25.921789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:25.924077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:26.053463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:26.082303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdfbf0-e572-4994-b30d-85cdf56a2f22 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.122716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.123297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.123579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.123855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.125755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:26.127255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:26.129006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 106/201] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:26.131234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af69d4-e2bb-4ced-9d17-263a5434aa09 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.137807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:26.187047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.188241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.188791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.189300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.201936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:26.207824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:26.208710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:26.209657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:26.212456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 96/202] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:26.219236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:26.315702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:26.371204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d137-f4ee-49e8-9e04-b688da544742 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.372824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343236-f89e-4f41-b516-2892af2e4119 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.413243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.414313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.414808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.415349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.417104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:26.417648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:26.419247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:26.429025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 97/203] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:26.434518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:26.471420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.472072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.472357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.472634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.473468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=116381016511423d811c369b96ef019b, user.id=2634f15320534b378968dc5fdd4e0cfb) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:26.473784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:26.475253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:26.490056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 107/204] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:26 2022] GET /identity/v3/role_assignments?user.id=2634f15320534b378968dc5fdd4e0cfb&scope.project.id=116381016511423d811c369b96ef019b&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:26.560122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c90a5-ca36-4b71-80eb-5624729d1d93 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.579497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:26.601867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.602997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.603591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.604086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] PATH_INFO: `/v3/users/dc461dbe03074dc3b0c37f978624c223` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.605772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] RBAC: Authorizing `identity:get_user(user_id=dc461dbe03074dc3b0c37f978624c223)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:26.607485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f1418-0db7-4869-b9a4-b83972b24f52 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:26.609369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 98/205] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:26 2022] GET /identity/v3/users/dc461dbe03074dc3b0c37f978624c223 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:26.618413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:26.640185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:26.781512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4dc6-e88c-46c2-84b7-ff3d02263dca None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:26.833496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:26.834138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:26.834425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:26.834705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:26.934903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:26.936371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:26.946769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.058973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a13a9-b63b-4ad3-bb55-3a0e997412d4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.059516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a13a9-b63b-4ad3-bb55-3a0e997412d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.059516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a13a9-b63b-4ad3-bb55-3a0e997412d4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.060875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 99/206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:27.065233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 108/207] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:27.066403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90290-c40a-4212-a1be-4f642012b405 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.066761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90290-c40a-4212-a1be-4f642012b405 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.067114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90290-c40a-4212-a1be-4f642012b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.077346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.091207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-71b90290-c40a-4212-a1be-4f642012b405 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:27.092520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-71b90290-c40a-4212-a1be-4f642012b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:27.187733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 100/208] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:27.189392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1501669-dfe1-4d4d-a058-130c0b78da1c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.189861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1501669-dfe1-4d4d-a058-130c0b78da1c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.190303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1501669-dfe1-4d4d-a058-130c0b78da1c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.191959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 101/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:27.195520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717a87-8733-4e81-900e-e263aa80c59c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.196932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.197880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.198293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.207148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.232015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:27.233360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:27.239842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.240740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.241257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.242240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.243606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.246691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.249914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 109/210] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:27.250883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.317133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 102/211] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:27.318230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.363461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288260-2de4-4db1-aa89-38b9940954a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.371633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.401690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.402375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.402658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.402940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.413993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:27.419798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:27.420640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:27.421424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 110/212] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:27.422077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.434980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242fe2-dd15-436c-98f1-f2e4f9841b9f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.465639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.476176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.476861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.477151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.477601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.478538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, scope.project.id=0dd1a24f035542db8609119486e52e30, user.id=dc461dbe03074dc3b0c37f978624c223) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:27.478857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.480314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.487221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 103/213] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/role_assignments?user.id=dc461dbe03074dc3b0c37f978624c223&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:27.488089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.583165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887db754-8798-4036-b312-7bc9de1336c3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.604878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96367-65d2-4410-a7df-03dc9264a24c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.614783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.644512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.645143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.645451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.645731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.646455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:27.646762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.648142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.649958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.650662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.650945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.651220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.658117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 104/214] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:27.658356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.659627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.661418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 111/215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:27.667388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.667745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.782007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1016e-a189-4d86-b876-ada17347f8a4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.823287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.823940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.824220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.824495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] PATH_INFO: `/v3/users/78b22a56b3e44dbaa889c19a32599ebc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.840369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] RBAC: Authorizing `identity:get_user(user_id=78b22a56b3e44dbaa889c19a32599ebc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.841874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.843882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 105/216] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/users/78b22a56b3e44dbaa889c19a32599ebc => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:27.848937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:27.852340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1ad5-5ada-4191-a6c7-15832ae5ea5a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:27.855874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.884136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:27.897856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:27.898544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:27.898829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:27.899103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:27.899806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:27.902038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:27.952887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 112/217] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:27 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:27.973124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8587-0f67-4ccd-a4dd-303e5ed23c80 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:28.013799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:28.014434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.014715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.014991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.092842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:28.094354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2403-0367-4af3-aa25-f19ac7a4ed8b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:28.125730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:28.203655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 106/218] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:28.209171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:28.316503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2295b-aa89-45aa-84c2-2fec04ea12a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:28.331246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e3e4-0f8b-4cc6-9f20-c192838c3dd4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.331525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e3e4-0f8b-4cc6-9f20-c192838c3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.331804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76e3e4-0f8b-4cc6-9f20-c192838c3dd4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.333441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 107/219] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:28.338650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.338926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.339200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.361470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:28.361714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.361855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.362187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.363362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:28.364835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:28.367045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 113/220] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:28 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:28.375400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:28.376703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:28.377090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:28.417076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:28.458742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:28.492260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f4b3c-dbd3-4dd5-b4ad-61986b0f214c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:28.499950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:28.533252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:28.534215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.534634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.535044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.535852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=116381016511423d811c369b96ef019b, user.id=78b22a56b3e44dbaa889c19a32599ebc) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:28.536169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:28.538622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:28.545130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 114/222] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:28 2022] GET /identity/v3/role_assignments?user.id=78b22a56b3e44dbaa889c19a32599ebc&scope.project.id=116381016511423d811c369b96ef019b&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:28.606470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:28.643786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63b7a-d707-49a4-9c0a-818a10b9ea05 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:28.702789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:28.703608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.703608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.703608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.722382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:28.727669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:28.729146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:28.730668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 109/223] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:28.735498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:28.852945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:28.866127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1229-f20e-4a0d-a069-be7dfc00b1e6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:28.907136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:28.907694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:28.907977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:28.908256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:28.908988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:28.909318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:28.910706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c1e3f-9f6a-48ff-ab37-477c1b539a34 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:28.920386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 115/224] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:28.925736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.029162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99304c-e490-4a8f-b156-174321fcf3ee None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.057670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:29.070940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774109-e95a-4f40-80d0-560a2922dc6e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.071231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774109-e95a-4f40-80d0-560a2922dc6e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.071507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774109-e95a-4f40-80d0-560a2922dc6e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.073573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 116/225] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:29.076057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.076726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.077011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.077318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.081183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:29.082681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:29.084480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 110/226] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:28 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:29.086476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.086720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.087000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.094917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.115721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:29.116931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:29.195596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 117/227] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:29.221482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.268369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fa78-7813-4706-8ddb-fcfbe8200476 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.325638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:29.335360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f860535-2f63-4abd-8b81-43547cbcf21f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.346074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.346734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.347331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.347746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.350007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:29.351487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:29.354076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:29 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:29.361845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.390177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.390837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.391122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.391402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.407177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:29.412997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:29.413888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:29.414632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:29.418570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:29.421446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.503119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:29.538302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef14f9-26f7-4c6c-92af-242dc962731c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.594169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753145-19e3-4013-a129-8d0a3115d3d3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.606548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.607188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.607475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.607752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.608480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:29.608790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:29.610205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:29.623172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 119/230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:29.636004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.637873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.638569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.638858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.639142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/users/2634f15320534b378968dc5fdd4e0cfb/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.641116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, user_id=2634f15320534b378968dc5fdd4e0cfb, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:29.642607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:29.648237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:29.666332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 112/231] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:29 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/users/2634f15320534b378968dc5fdd4e0cfb/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:29.762547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c4d45-4428-4eab-8fea-6050a5a7eb90 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.812909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:29.814001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:29.814497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:29.817882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:29.819601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:29.821298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:29.824073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 120/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:29 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:29.834463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:29.961894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4033fc1-2a8d-45d9-b0b5-d0850bb4f48f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:29.977592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:30.001692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:30.002344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.002631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.002909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.004115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:30.005597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd913a-61ea-479a-bfc6-1039e97b88bf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:30.007285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 113/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:29 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:30.013327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:30.128187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:30.158188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7475ca-6392-42b9-8983-62343fe866d1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:30.199725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:30.200408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.200692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.200970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/users/2634f15320534b378968dc5fdd4e0cfb/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.203284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, user_id=2634f15320534b378968dc5fdd4e0cfb, role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:30.204804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96a389-e61a-4903-ae43-c2cdb7211d32 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:30.224024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:30 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/users/2634f15320534b378968dc5fdd4e0cfb/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:30.765666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844719e-a405-42d0-a164-695ccd6a005f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.766204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844719e-a405-42d0-a164-695ccd6a005f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.766204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844719e-a405-42d0-a164-695ccd6a005f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.768966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:30.775799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb23180-694e-4515-88e4-8343238226db None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.776088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb23180-694e-4515-88e4-8343238226db None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.776370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb23180-694e-4515-88e4-8343238226db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.811011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9fb23180-694e-4515-88e4-8343238226db None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:30.812215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9fb23180-694e-4515-88e4-8343238226db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:30.831812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a00-ac94-45a2-b167-047d1c577abe None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.832097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a00-ac94-45a2-b167-047d1c577abe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.832370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a00-ac94-45a2-b167-047d1c577abe None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.834117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 115/236] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:30.839590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:30.839878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:30.840159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:30.858781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:30.859993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:30.924748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 122/237] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:30.937352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:30.954505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb23180-694e-4515-88e4-8343238226db None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:30.962340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.073202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.153411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb23180-694e-4515-88e4-8343238226db None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.161291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978fba0-ee3a-4cd4-ab4e-d00825cc8eb8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.171967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.199137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.199789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.200073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.200513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.204577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.205227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.205530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.205806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.208916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:31.210400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f9e1-4539-42b9-a2c8-a9573e8a81a5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:31.212310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 117/239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:31.214198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72953-92d1-4e50-afc8-96a62878f6c3 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.214617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72953-92d1-4e50-afc8-96a62878f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.215017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72953-92d1-4e50-afc8-96a62878f6c3 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.216396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 118/240] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:31.220734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:31.222620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72953-92d1-4e50-afc8-96a62878f6c3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-481278e4-59ef-4226-9a01-1f3f6603582b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:31.228009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:31.229000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:31.229794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:31.230364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 123/241] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:31.231532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.231882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.232172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.255480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:31.257111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:31.335930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72953-92d1-4e50-afc8-96a62878f6c3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.350747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 124/242] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:31.351610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.393468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.394497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.395031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.395543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.396481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:31.398239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:31.419430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.426160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 119/243] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:31 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:31.434669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.469834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825554af-4abf-49df-bfe3-01f5ac5397a4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.509292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.510690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.511101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.511484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.512324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:31.512738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:31.514347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:31.514816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.527194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 125/244] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:31.535448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.649368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77d0-2412-4584-80a4-d6558a6696f1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.687285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.687953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.688242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.688531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.699799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e8b1-a3da-4f23-85e3-dc90b912837f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.701088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:31.706664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:31.707512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:31.708294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:31.710261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 120/245] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:31.716392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.729638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.743019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.743685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.744502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.744788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] PATH_INFO: `/v3/users/7a64fdd84f334c5bbaa856442a389fdc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.762011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] RBAC: Authorizing `identity:get_user(user_id=7a64fdd84f334c5bbaa856442a389fdc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:31.763519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:31.769383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 126/246] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/users/7a64fdd84f334c5bbaa856442a389fdc => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:31.771936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.844111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:31.853623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d6b0-2fbe-48b3-9575-e25c05ca38b5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.905012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.905773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.906065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.906663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:31.907672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:31.907988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:31.909203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb178cf-09cb-4391-844e-8279e8a20c7b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:31.909438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:31.923212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 121/247] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:31.928843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:31.966145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:31.966792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:31.967225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:31.967508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.037633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:32.066512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.066804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073134c-5087-4d16-9dde-9a25b88ebd80 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.067995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec49341-7514-43be-aba9-d46bc2e4bc68 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.106365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.107019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.107585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] PATH_INFO: `/v3/users/78b22a56b3e44dbaa889c19a32599ebc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.109820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] RBAC: Authorizing `identity:get_user(user_id=78b22a56b3e44dbaa889c19a32599ebc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.110883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8cc7ce-7ce3-4a4e-aa21-58be9d0fae07 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.112770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/users/78b22a56b3e44dbaa889c19a32599ebc => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:32.119536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4284e8-2553-4e03-9d3c-085fa0e7ac30 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.119536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4284e8-2553-4e03-9d3c-085fa0e7ac30 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.119749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4284e8-2553-4e03-9d3c-085fa0e7ac30 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.122029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 123/249] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:32.122140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4284e8-2553-4e03-9d3c-085fa0e7ac30 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.155342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:32.205244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 127/250] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:32.208168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.208694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.209338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.239014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:32.240853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:32.253422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4284e8-2553-4e03-9d3c-085fa0e7ac30 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.308539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.309198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.309512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.309792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.311007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.314426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.316339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 124/251] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:32 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:32.316899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.359086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 128/252] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:32.360241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.365219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:32.460796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:32.473407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4d83-69bc-4588-a01b-0f66b8d6156d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.527079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d901b0-ac41-4c9b-8e5f-d009069e5a77 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.569986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.570222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.570653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.570765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.570930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.571022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.571211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/users/78b22a56b3e44dbaa889c19a32599ebc/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.571315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.574003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.575549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.577282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 125/253] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:32 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:32.578626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, user_id=78b22a56b3e44dbaa889c19a32599ebc, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.580074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.582854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.603379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 129/254] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:32 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/users/78b22a56b3e44dbaa889c19a32599ebc/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:32.603971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.744817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:32.806798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b0d6-dff8-4d00-a533-67205c2e5642 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.836015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5233f-965d-40fd-a6ba-e656a4a4777b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:32.886474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.886474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.886474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.886474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.907284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:32.907920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:32.908205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:32.908482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:32.909315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, scope.project.id=116381016511423d811c369b96ef019b, user.id=7a64fdd84f334c5bbaa856442a389fdc) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:32.909811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:32.911269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:32.919706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:32.926328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:32.927161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:32.928329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 126/255] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:32.934609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 130/256] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:32 2022] GET /identity/v3/role_assignments?user.id=7a64fdd84f334c5bbaa856442a389fdc&scope.project.id=116381016511423d811c369b96ef019b&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:32.935561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:32.973732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:33.053006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c9baf-74a0-4e7e-941e-b2905bde78a5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:33.090248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:33.090880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.091169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.091449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.092180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:33.092489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:33.093921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265baaf-9953-443a-9bca-5ed1a7c49ceb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:33.104367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 127/257] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:33.109631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:33.124780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565096-a7cd-47bd-9d1a-dd9e139127ef None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.125082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565096-a7cd-47bd-9d1a-dd9e139127ef None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.125376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565096-a7cd-47bd-9d1a-dd9e139127ef None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.126933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 128/258] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:33.132875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.133161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.133467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.176245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:33.177524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:33.319102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e055d-8f73-4edf-963e-387fdc0dd935 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:33.324910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 129/259] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:33.371127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:33.386186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:33.387224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.387726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.388205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.392204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:33.392827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:33.394188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:33.396150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 131/260] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:33.401948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:33.419988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:33.568202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d3d71-044f-46e0-8a7b-fda842fa20f3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:33.579277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067474-f42c-41c5-aeeb-3a94d916ada5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:33.629620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:33.630271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.630548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.630819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.638089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:33.638714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.638994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.639267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.652517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:33.657512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:33.658460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:33.659611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 130/261] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:33.667672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:33.757657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:33.768699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:33.770216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:33.799488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:33.853903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d24d-48a1-46e8-8557-39f30db6eeaf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:33.954329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:33.954939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:33.955216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:33.955488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:33.956199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:33.956501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:33.957914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:33.964206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 132/262] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:33.973769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:33.979190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:33.984993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:34.190692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:34.194484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee260-1be0-4510-b818-377d0b1020e4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:34.211393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371f15-eafb-4af2-9172-f9eba1778818 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:34.297137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:34.298512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.298802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.300332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] PATH_INFO: `/v3/users/2634f15320534b378968dc5fdd4e0cfb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.302205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] RBAC: Authorizing `identity:get_user(user_id=2634f15320534b378968dc5fdd4e0cfb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:34.305124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:34.315083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 132/264] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/users/2634f15320534b378968dc5fdd4e0cfb => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:34.322344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:34.325288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.325288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.325288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.325288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:34.326145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:34.327944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 133/265] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:33 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:34.328544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:34.340028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:34.345637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:34.589629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14629c-6408-4c51-afb5-13dc3320dac2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:34.625734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3dd8-8dfc-4566-9d4c-a508c234248c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:34.657937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:34.660186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.662086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.663279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.670831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:34.671479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.671902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.672189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.673012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=116381016511423d811c369b96ef019b, user.id=2634f15320534b378968dc5fdd4e0cfb) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:34.673358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:34.676270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2ece-28c9-47b4-a8df-0adb8f777c38 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:34.684737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:34 2022] GET /identity/v3/role_assignments?user.id=2634f15320534b378968dc5fdd4e0cfb&scope.project.id=116381016511423d811c369b96ef019b&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:34.686457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8c9-06e9-45f6-8d2b-a13a728d99c3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.686748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8c9-06e9-45f6-8d2b-a13a728d99c3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.687030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b8c9-06e9-45f6-8d2b-a13a728d99c3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.688558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 135/267] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:34.697392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb87b-7552-4a33-9bbe-56a6d587316a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.697392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb87b-7552-4a33-9bbe-56a6d587316a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.697392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb87b-7552-4a33-9bbe-56a6d587316a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.697392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 136/268] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:34.701288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c417-ad84-44db-8fdc-19842bade3ae None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.701288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c417-ad84-44db-8fdc-19842bade3ae None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.701288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c417-ad84-44db-8fdc-19842bade3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.736872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-12c6c417-ad84-44db-8fdc-19842bade3ae None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:34.738143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-12c6c417-ad84-44db-8fdc-19842bade3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:34.781281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:34.887495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:34.890414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:34.890650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 137/269] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:34.891858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:34.892151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:34.892433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:34.899031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:34.941821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:34.943020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:35.021610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 138/270] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:35.022494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.042156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 133/271] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:35.049193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.147539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.167980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2e014-a778-49c8-8096-87acb9df511a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.172885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b81f9-6505-42e1-992b-8409d9af434c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.175463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.206078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.207112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.207680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.208261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.209707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.211596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.214523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 139/272] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:35.215503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.221935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.222922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.223414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.223890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.225334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.227002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.229900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 134/273] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:35.235477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.336633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d7a8-ab0c-4286-b732-5f19738bf46e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.343908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d6a8-8100-4e2a-92ee-130906348d6a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.372425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.373091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.373408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.373691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.382496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.383569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.384045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.384611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.385401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:35.385760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.387386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:35.391006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:35.391866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:35.392649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 140/274] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:35.393295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.414478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.416964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 135/275] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:50:35 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:35.418341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.457322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.553257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744741-398d-4d96-aaf3-d5223b045807 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.595305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.596354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.596939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.597454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.598417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:35.598957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.600815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.611628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 136/276] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:35.618387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.629006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db9b50-c37b-4b41-91cf-dd1d3d6454ac None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.667418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.667972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.668253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.668529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.669369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=116381016511423d811c369b96ef019b, user.id=2634f15320534b378968dc5fdd4e0cfb) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:35.669687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.671270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52006f88-f450-4a87-bd50-3d387d199c5f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.678512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 141/277] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/role_assignments?user.id=2634f15320534b378968dc5fdd4e0cfb&scope.project.id=116381016511423d811c369b96ef019b&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:35.732110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.745427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e218d3-2682-45dd-9a49-14c3d08317d0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:35.793539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:35.794211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.794501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.794785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] PATH_INFO: `/v3/users/138e33c5f7f943fdaba89d93ea1016fc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.805829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d9f-a101-47c8-bf8f-ef7e23dc06d2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.806176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d9f-a101-47c8-bf8f-ef7e23dc06d2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.806431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d9f-a101-47c8-bf8f-ef7e23dc06d2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.808239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 142/278] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:35.812094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] RBAC: Authorizing `identity:get_user(user_id=138e33c5f7f943fdaba89d93ea1016fc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:35.813920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a612d-d534-4625-8121-7fff919ebac2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:35.814498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3641bf-8526-4729-9a2c-49dbe8828f75 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.815402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3641bf-8526-4729-9a2c-49dbe8828f75 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.815886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3641bf-8526-4729-9a2c-49dbe8828f75 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.816879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 137/279] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/users/138e33c5f7f943fdaba89d93ea1016fc => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:35.817330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 143/280] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:35.818590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580125d4-1cc2-4c8e-a294-e2e25b38e60b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.819083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580125d4-1cc2-4c8e-a294-e2e25b38e60b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.819553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580125d4-1cc2-4c8e-a294-e2e25b38e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.824549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3641bf-8526-4729-9a2c-49dbe8828f75 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:35.842683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-580125d4-1cc2-4c8e-a294-e2e25b38e60b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:35.844452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-580125d4-1cc2-4c8e-a294-e2e25b38e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:35.942943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 138/281] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:35.945026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:35.945414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:35.945758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:35.950403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:35.973374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:35.974670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:35.985131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3641bf-8526-4729-9a2c-49dbe8828f75 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.033147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.033934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.034225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.034500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.035298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, user.id=138e33c5f7f943fdaba89d93ea1016fc, scope.system=all) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:36.035611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.037061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.043821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 144/282] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 19:50:35 2022] GET /identity/v3/role_assignments?user.id=138e33c5f7f943fdaba89d93ea1016fc&scope.system=all&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:36.044447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.073205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 139/283] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:36.100254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.113640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:36.195959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd9f89-49e2-4064-b350-edd0d8f373fb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.234297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.235013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.235303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.235580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.248951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e94b9b-8b33-4128-b357-b4ac21e9cc0d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.249936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:36.255204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:36.256077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:36.256849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 145/284] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:36.265290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.273064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:36.321304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.322665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.322948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.323224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.336666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:36.342029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:36.342924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:36.344140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 140/285] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:36.350335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.421570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720cf4d-6b9c-430b-89f8-2106b572a876 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.476917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:36.511650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.511845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc90722-bb86-4f2d-a4c0-1714ccf2e297 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.512796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.513363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.513840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.514761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:36.515283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.516997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.538797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 146/286] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:36.545197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.547510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.548174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.548531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.548807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.549669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:36.549975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.551360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.563582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 141/287] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:36.569110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.674581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69683cae-2d69-49f5-903d-3752227d807c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.705661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:36.714441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:36.714722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.715109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.715438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.715855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] PATH_INFO: `/v3/users/7a64fdd84f334c5bbaa856442a389fdc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.720689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a64fdd84f334c5bbaa856442a389fdc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.720689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.720870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/users/7a64fdd84f334c5bbaa856442a389fdc => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:36.726475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.778135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5604f-9e3c-41d7-8fdf-34c4478ed107 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.835039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec2b7-1076-4d70-a44c-c3b20a8b2fc0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:36.840345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.841226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.841762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.842241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] PATH_INFO: `/v3/users/78b22a56b3e44dbaa889c19a32599ebc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.846317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] RBAC: Authorizing `identity:get_user(user_id=78b22a56b3e44dbaa889c19a32599ebc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.848003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.857914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/users/78b22a56b3e44dbaa889c19a32599ebc => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:36.875214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:36.918320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:36.918988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:36.919275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:36.919565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:36.922854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:36.924322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:36.926028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:36.932885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:37.079302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e629097-574e-4013-bf5f-26fcb7b1d074 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:37.094800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:37.156539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:37.157170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:37.157490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:37.157770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:37.169576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:37.170055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c311-c013-4e79-a334-10dfb2086c01 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:37.239452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:37.240278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:37.240807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:37.241094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/users/7a64fdd84f334c5bbaa856442a389fdc/roles/49ad12f713384bd298c9e1a3de23d6e7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:37.247702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, user_id=7a64fdd84f334c5bbaa856442a389fdc, role_id=49ad12f713384bd298c9e1a3de23d6e7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:37.249158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:37.262670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:37.264328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:37.272969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 144/291] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:50:36 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/users/7a64fdd84f334c5bbaa856442a389fdc/roles/49ad12f713384bd298c9e1a3de23d6e7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:37.397491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 148/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:37.399145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:37.549123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4aa5d-26d6-4f57-8195-c550ad91436c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:37.583107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:37.594991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:37.595647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:37.595928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:37.596205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:37.602202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:37.604435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf07c8-3463-4088-8eb9-150777bca375 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:37.606634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 145/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:37 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:37.612471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:37.662197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:37.736517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f68822-a4d6-4de9-8ee9-75574abda742 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:37.776077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:37.776703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:37.776989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:37.777279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:37.778141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=116381016511423d811c369b96ef019b, user.id=78b22a56b3e44dbaa889c19a32599ebc) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:37.778450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:37.779927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9028-9307-470d-97f9-f1bd87fa9658 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:37.786334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 149/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:37 2022] GET /identity/v3/role_assignments?user.id=78b22a56b3e44dbaa889c19a32599ebc&scope.project.id=116381016511423d811c369b96ef019b&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:38.038150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005c41-b704-495c-ab8c-75eb07ea25e9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.038337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005c41-b704-495c-ab8c-75eb07ea25e9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.038614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005c41-b704-495c-ab8c-75eb07ea25e9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.040244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 146/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:38.045848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.046139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.046423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.067977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:38.069185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:38.122627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62bc68-4cc8-40f9-8062-12d1a32dd334 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.123240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62bc68-4cc8-40f9-8062-12d1a32dd334 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.123240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62bc68-4cc8-40f9-8062-12d1a32dd334 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.124805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 147/296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:38.131545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.131832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.132109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.155240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 150/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:38.158336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:38.159553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:38.185147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.226047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:38.255292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 148/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:38.285908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.329557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b617b4-7db4-4ff6-b9e0-08c2fbd836dd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.374228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.374889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.375177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.375459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.376937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:38.379348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:38.381339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 151/299] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:38.387115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.411416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945addb2-cc24-4145-9cad-8046886421b4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.441653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:38.455159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.456105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.456610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.457147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.470100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:38.475840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:38.476683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:38.477470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:38.480364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 149/300] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:38.486818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.512338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:38.519624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487f97-f05f-47ba-ae0d-c18fe4d2b337 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.559499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.560136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.560423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.560700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] PATH_INFO: `/v3/groups` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.561931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:38.563707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de5e2e-11f1-4395-a378-e7bd7517866d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:38.581878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 152/301] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 19:50:38 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:38.583279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f9bf-8754-4378-8f98-2a7eb3888765 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.583573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f9bf-8754-4378-8f98-2a7eb3888765 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.584180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f9bf-8754-4378-8f98-2a7eb3888765 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.589308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 153/302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:38.601599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.602125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.602552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.629892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded55fc2-2f7f-4d69-aed3-10416a437420 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.630801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:38.633848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:38.679543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.680445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.680820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.681254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.682107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:38.682514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:38.685460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:38.697653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 150/303] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:38.703860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.732701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 154/304] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:38.749421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.758474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:38.828446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37a46-93ac-46bf-acc8-0836a57f7aa8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.843103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:38.859569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e923-f727-477e-8cac-d0c44854c684 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:38.866754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.867629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.868055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.868500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] PATH_INFO: `/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.898879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] RBAC: Authorizing `identity:get_user(user_id=78a2414d935d4eb9b55d3ad58efbdfcc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:38.901455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:38.904082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 151/305] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:38.907105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:38.907955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:38.908359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:38.908732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:38.909782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:38.922638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:38.928590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:38.929763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:38.930742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:38.937991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 155/306] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:38.939139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:39.039779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ceca7-fefd-4892-9ecd-69479e1437b1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:39.042993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:39.054310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be55dec-12a5-4215-9a31-84c880bc9d98 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:39.086067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:39.086973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.087964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.088383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.089537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, user.id=78a2414d935d4eb9b55d3ad58efbdfcc, scope.system=all) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:39.090007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:39.091810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:39.094800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:39.095370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.095656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.095932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.097056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:39.097669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:39.099056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:39.099410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 152/307] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/role_assignments?user.id=78a2414d935d4eb9b55d3ad58efbdfcc&scope.system=all&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:39.118131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 156/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:39.124811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:39.232785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f5a8e-1334-4751-b6d8-738445ef669d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:39.276147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:39.276804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.277088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.277401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] PATH_INFO: `/v3/users/138e33c5f7f943fdaba89d93ea1016fc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.278593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] RBAC: Authorizing `identity:get_user(user_id=138e33c5f7f943fdaba89d93ea1016fc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:39.280038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f025cf-692d-4295-baee-6057dfee72e5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:39.282008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 153/309] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:39 2022] GET /identity/v3/users/138e33c5f7f943fdaba89d93ea1016fc => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:39.287779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:39.302306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:39.399824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1531b-41ee-40d3-b0cb-d9a05a24a900 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:39.435124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:39.436123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.436643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.437171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] PATH_INFO: `/v3/system/users/138e33c5f7f943fdaba89d93ea1016fc/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.438922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=138e33c5f7f943fdaba89d93ea1016fc, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:39.440502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05790a3-1818-4ab0-88bc-4993e557fcc5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:39.453662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 157/310] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 19:50:39 2022] PUT /identity/v3/system/users/138e33c5f7f943fdaba89d93ea1016fc/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:39.833856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95f5-7969-487d-b725-7bb558edb52f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.834035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95f5-7969-487d-b725-7bb558edb52f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.834322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f95f5-7969-487d-b725-7bb558edb52f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.835950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 154/311] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:39.841635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:39.842065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:39.842227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:39.865482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:39.866682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:39.942208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 158/312] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:39.965030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f95f5-7969-487d-b725-7bb558edb52f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.002714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.070111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f95f5-7969-487d-b725-7bb558edb52f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.104491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:40.105139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.105460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.105737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.115965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:40.120969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:40.121876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:40.122663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 155/313] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:40.128143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.130353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.238790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af66a00-3006-4d77-a125-d7de2ea20610 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.273819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:40.274443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.274791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.275069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.275794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:40.276102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:40.277528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:40.286121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 159/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:40.292222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.396730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650214e-0aea-4c69-bd7e-a3a75fdf6530 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.404166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.431916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:40.432561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.432841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.433168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] PATH_INFO: `/v3/users/7a64fdd84f334c5bbaa856442a389fdc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.434355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] RBAC: Authorizing `identity:get_user(user_id=7a64fdd84f334c5bbaa856442a389fdc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:40.437096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14fe83-d62e-4b6b-9a2e-96952a96bbf4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:40.438733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 156/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/users/7a64fdd84f334c5bbaa856442a389fdc => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:40.444229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.518902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.554137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0199-c9da-48bf-9722-229873b2ec15 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.591305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:40.591961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.592242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.592517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.663884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:40.665800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:40.702789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fed9-3153-4e6a-a34d-af449c20a768 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.703094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fed9-3153-4e6a-a34d-af449c20a768 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.703363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fed9-3153-4e6a-a34d-af449c20a768 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.704869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 157/316] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:40.710357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.710641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.710917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.733605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.733880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:40.735398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:40.777631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 160/317] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:40.784522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.833372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 158/318] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:40.856036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:40.921605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ca9c-f61b-4f2d-873a-63e539e1d903 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.964984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:40.971251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:40.972369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:40.972829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:40.973294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:40.973784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891f6e-f748-4c43-94cb-21e3733e9053 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:40.974846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:40.977671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:40.985181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 161/319] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:40.986322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.014759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.015499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.015847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.016187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.017558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:41.019180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:41.026404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 159/320] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:41.027497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:41.028966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.118529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ce4f-5c97-47d0-b9d3-169238e60775 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.140183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b922-1828-4883-9f16-cf0b743c4b58 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.164162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.165945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.166423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.166861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.167819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, scope.project.id=116381016511423d811c369b96ef019b, user.id=7a64fdd84f334c5bbaa856442a389fdc) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:41.168311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:41.169967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef4f9-de5a-46f5-82e6-522acf503f9b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:41.178851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 162/321] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:50:40 2022] GET /identity/v3/role_assignments?user.id=7a64fdd84f334c5bbaa856442a389fdc&scope.project.id=116381016511423d811c369b96ef019b&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:41.184491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.185465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.185976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.186462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] PATH_INFO: `/v3/groups` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.187340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:41.189014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19c99-1b5b-4fa8-b244-f209e6e13dcd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:41.213527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 160/322] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 19:50:41 2022] POST /identity/v3/groups => generated 226 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:50:41.255251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864911f-1b69-42ad-8622-e0288863b5a3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.255548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864911f-1b69-42ad-8622-e0288863b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.255851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864911f-1b69-42ad-8622-e0288863b5a3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.257666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 163/323] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:41.264109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40f93-3025-4036-9bba-db5f19e4a434 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.264400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40f93-3025-4036-9bba-db5f19e4a434 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.264686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40f93-3025-4036-9bba-db5f19e4a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.285221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-abf40f93-3025-4036-9bba-db5f19e4a434 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:41.286500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abf40f93-3025-4036-9bba-db5f19e4a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:41.307496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:41.370091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 161/324] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:41.393109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864911f-1b69-42ad-8622-e0288863b5a3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.504990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:41.512475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864911f-1b69-42ad-8622-e0288863b5a3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.517735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657b2b-af02-40d6-a451-9b6db6f8c636 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.518028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657b2b-af02-40d6-a451-9b6db6f8c636 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.518363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657b2b-af02-40d6-a451-9b6db6f8c636 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.520155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 162/325] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:41.526890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.527181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.527460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.546665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:41.548813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:41.555591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.556290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.556575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.556850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.568778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:41.574381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:41.575482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:41.576367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 164/326] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:41.581345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.643852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 163/327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:41.667780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.705358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdfdf8-c096-4957-a157-9cb0a79dc5a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.742780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.743761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.744046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.744321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.745050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:41.745711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:41.746774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:41.760969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 165/328] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:41.765829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.768275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:41.795197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:41.795945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba876e-43a2-4e6a-ab35-12243d5612d9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.843050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.844118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.844660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.844942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.859925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:41.864910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:41.865806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:41.866556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:41.867140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 164/329] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:41.873638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:41.931279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a1ad-529c-4433-9f02-4f32922b1b0d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:41.977567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:41.978901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:41.979180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:41.979455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] PATH_INFO: `/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:41.981234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] RBAC: Authorizing `identity:get_user(user_id=78a2414d935d4eb9b55d3ad58efbdfcc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:41.982658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:41.985012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 166/330] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:41 2022] GET /identity/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:41.990424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:42.006216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d438-4fb3-4038-989f-e3e2056f13f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:42.050570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:42.051116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:42.051396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:42.051670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:42.052401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:42.052686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:42.054206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:42.069438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 165/331] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:42.074542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:42.097661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:42.112897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:42.150581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa1e07-4c52-45a6-9c11-463d350db192 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:42.215288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:42.215963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:42.216241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:42.216524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] PATH_INFO: `/v3/system/users/78a2414d935d4eb9b55d3ad58efbdfcc/roles/49ad12f713384bd298c9e1a3de23d6e7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:42.218132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=78a2414d935d4eb9b55d3ad58efbdfcc, role_id=49ad12f713384bd298c9e1a3de23d6e7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:42.219512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:42.234627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 167/332] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 19:50:41 2022] PUT /identity/v3/system/users/78a2414d935d4eb9b55d3ad58efbdfcc/roles/49ad12f713384bd298c9e1a3de23d6e7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 19:50:42.242585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301dfd-a5cc-4763-8d72-7b67be0d3e3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:42.280517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:42.281171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:42.281480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:42.281813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] PATH_INFO: `/v3/users/138e33c5f7f943fdaba89d93ea1016fc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:42.283121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=138e33c5f7f943fdaba89d93ea1016fc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:42.284620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e84063-775f-466e-8202-c880207eb3f5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:42.286547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 166/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:42 2022] GET /identity/v3/users/138e33c5f7f943fdaba89d93ea1016fc => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:42.294477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:42.435428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8adbc-cb25-45e6-ad1e-0930d04514e0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:42.477504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:42.478683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:42.478966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:42.479243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:42.480059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] RBAC: Adding query filter params (role.id=d4e2d689cd514e8c861f5736930af1d6, user.id=138e33c5f7f943fdaba89d93ea1016fc, scope.system=all) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:42.480371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:42.481890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326eed-eb90-4342-8ef8-e3381bc8bcc5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:42.502497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 168/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 19:50:42 2022] GET /identity/v3/role_assignments?user.id=138e33c5f7f943fdaba89d93ea1016fc&scope.system=all&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:43.839805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185df4b-9b39-4d26-b439-74c7b76a5a30 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:43.840311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185df4b-9b39-4d26-b439-74c7b76a5a30 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:43.840394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185df4b-9b39-4d26-b439-74c7b76a5a30 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:43.841977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 167/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:43.858993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:43.859495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:43.859571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:43.893259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:43.894492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:43.896645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:43.985635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:44.012827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185df4b-9b39-4d26-b439-74c7b76a5a30 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.093907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:44.134970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185df4b-9b39-4d26-b439-74c7b76a5a30 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:44.172745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:44.173428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.173713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.173992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.194213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:44.199792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:44.200634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:44.201859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 168/337] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:44.206900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.323061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b7e67-a53d-4699-925d-b4948bc70fbb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:44.366846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:44.367408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.367682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.367954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.369338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:44.369654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:44.371065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f89ee-960e-4da4-ade5-d2308a887188 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:44.378587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:44.388578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 170/338] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:44.393454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.451078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d1b4-ea90-4b38-b449-ac193dc35867 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.451777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d1b4-ea90-4b38-b449-ac193dc35867 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.452313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d1b4-ea90-4b38-b449-ac193dc35867 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.454200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 171/339] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:44.460204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.460802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.461354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.484600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:44.487269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:44.542751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158a864-1b81-4c76-8591-aa97192df34d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:44.581522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:44.588452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:44.589546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.589864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.590150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.600727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 172/340] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:44.629163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.670309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:44.671779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:44.746717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208104e-a4e3-4a19-a5d8-7defd7057158 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:44.781555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:44.791438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:44.792391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.792875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.793384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.794214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:44.801739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.809188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:44.814943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:44.815822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:44.816613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:44.822236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 173/342] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:44.825862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:44.857654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:44.920541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e88e-a166-4002-9d29-3ebd0cada715 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:44.963336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:44.963997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:44.964284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:44.964564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:44.965775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:44.968876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:44.969804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 170/343] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:44.975403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.023335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2381-af2e-4d95-a4f7-a541877d4b7e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.098123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.098772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.099053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.099328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.100062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:45.100371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.101807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:45.117648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.120726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b411ce-b344-4154-b5e3-ba28ca165edf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.124431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 174/344] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:45.130160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.194202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.194801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.195086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.195367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.217969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.219459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b3c4-2189-450a-b317-05398468048b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:45.221499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 171/345] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:44 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:45.221872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.236314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653034-7144-4ff6-9162-b129fac8c37d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.236606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653034-7144-4ff6-9162-b129fac8c37d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.236884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653034-7144-4ff6-9162-b129fac8c37d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.238277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 172/346] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:45.242113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653034-7144-4ff6-9162-b129fac8c37d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.283006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5419c1-d092-45eb-b0ac-c3df1e966c8e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.326580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.327217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.327501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.327781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.419161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.420643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:45.444676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653034-7144-4ff6-9162-b129fac8c37d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.483724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.484351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.484633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.484908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.487515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=0dd1a24f035542db8609119486e52e30) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:45.487841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.489299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f0281-ed08-4647-93dd-7424e8eab42e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:45.495506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 173/347] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:45 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:45.496791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.497072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.499545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.500121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.520784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:45.522222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:45.549669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.599918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 174/348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:45.626099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.632722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 175/349] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:45.638872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.740013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7f66a-1c6a-49ad-967f-dd23d7135b2e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.794589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.795261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.795542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.795824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.807732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a1b001ed-93cc-4c7c-964d-b2cf2b93685b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:45.814087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:45.815031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:45.816354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 175/350] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:45.817000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9828-954a-4aa6-9099-bf846afe2c17 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.817302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9828-954a-4aa6-9099-bf846afe2c17 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.821654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b9828-954a-4aa6-9099-bf846afe2c17 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.824588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 176/351] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:45.825462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b9828-954a-4aa6-9099-bf846afe2c17 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:45.853647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.867386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602518-9a6b-4455-8a2b-839782eee93d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.922033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.922708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.922997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.923281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.924543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.926065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bf561-306e-4fa7-90e3-24b1917063cc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:45.928067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 176/352] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:45 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:45.929232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.932811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.933108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.951865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b9828-954a-4aa6-9099-bf846afe2c17 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:45.967586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:45.968798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:45.989304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:45.990762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:45.991340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:45.991620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:45.991895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:45.992616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:45.992922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:45.994884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.005291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 177/353] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:46.006148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.121942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 177/354] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:46.122825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.123646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008630d-82e4-44ac-8c2c-fde77126f68d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.141761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.172341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.173001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.173294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.173826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.175578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:46.177337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470b8a-68d1-4e8f-a474-24c3966dd547 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.179801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 178/355] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:46.181064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a90f-c79f-457a-af1b-07992fae6c9f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.181374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a90f-c79f-457a-af1b-07992fae6c9f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.181651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a90f-c79f-457a-af1b-07992fae6c9f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.184014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 179/356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:46.184738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a90f-c79f-457a-af1b-07992fae6c9f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.251966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76cfea-d5ca-45db-89b6-ccc616ccf215 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.300772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.301459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.301749 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.302036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.315003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a90f-c79f-457a-af1b-07992fae6c9f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.324288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.365081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.365915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.366201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.366542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.379067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:46.384682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:46.385597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:46.386386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 180/357] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:46.387026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.388386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:46.390198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f71b3-f7ec-4f55-8a30-a2924fc91b3b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.404627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.534435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0022a-c4a0-4385-94bf-179306e6926b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.535934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 178/358] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:46.537309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.538111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.538111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.561927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:46.563383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:46.583792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.584468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.584756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.585047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.585870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=116381016511423d811c369b96ef019b) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:46.586185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:46.588558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba189d49-f25e-4120-90ee-8e5391d66f01 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.597878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 181/359] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=116381016511423d811c369b96ef019b&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:46.599446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac35b0-a37a-4c03-94ef-ed81f818d396 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.599943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac35b0-a37a-4c03-94ef-ed81f818d396 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.600446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac35b0-a37a-4c03-94ef-ed81f818d396 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.602606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 182/360] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:46.603826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac35b0-a37a-4c03-94ef-ed81f818d396 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.651274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.670740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 179/361] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:46.682640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.701825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.744968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac35b0-a37a-4c03-94ef-ed81f818d396 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.800513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.802094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.804320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.804320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.804320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:46.804320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:46.806359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113f83-2bb0-4013-8e0b-9d5b2b6c5428 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.816945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 183/362] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:46.818348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.818742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.819116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.824928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab650e8-5e39-4c46-aa9b-ba07020c8369 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:46.847763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:46.848955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:46.868343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:46.869392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:46.869825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:46.870352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:46.871661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:46.873408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:46.875366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 180/363] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:46.876346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:46.936081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:46.939152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 184/364] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:46.940102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.001355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270afe2-8d5f-4792-a879-367cc38b4058 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.040677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.052420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.053461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.053947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.054457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.066505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:47.072813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:47.073703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 19:50:47.074463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:47.077373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 181/365] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:47.078440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.085788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952e2c-b44e-4902-b3bc-858d664a7db9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.130967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.131947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.132453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.132929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.214584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75708-e00e-4eb1-9d0b-7872ae4ea3c5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.225225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.229929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.231836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:47.269201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.269885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.270165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.272641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.273880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.275336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:47.277391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 182/366] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:47.278104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.314753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.371384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 185/367] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:47.371384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.421384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5755-cce9-4c3a-a20c-3faa47d06875 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.470943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.472122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.473467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.473979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.488163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:47.495954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:47.496840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:47.497651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:47.498806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 183/368] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:47.501112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.510459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03431-a74d-48d2-b37e-65db8f0880cb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.549559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.550191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.550478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.550754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.551476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:47.552034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.553156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:47.556871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.563405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 186/369] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:47.564383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.597713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.648450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d8b0-90a9-4b0c-8326-e67591c7cb7a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.685671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f451d-d3a2-425f-8176-ae4a38c6d4c6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.693909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.694543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.695238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.695238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.695987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=0dd1a24f035542db8609119486e52e30) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:47.696835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.698512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:47.705681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 184/370] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:47.706548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.752089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.753223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.753639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.754687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.756111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.759604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:47.762724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 187/371] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:47.764125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:47.912033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.916588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58937735-ec77-4e8a-b934-b8c7155572a1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.977805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:47.988070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae620-dba0-47d4-b202-04166868bba2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:47.990312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:47.991000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:47.991292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:47.991568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:47.992299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:47.992609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:47.994933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.015662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 185/372] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.022294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.060515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.061239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.061592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.061878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] PATH_INFO: `/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.063081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] RBAC: Authorizing `identity:get_user(user_id=78a2414d935d4eb9b55d3ad58efbdfcc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.065147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.067372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 188/373] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:50:47 2022] GET /identity/v3/users/78a2414d935d4eb9b55d3ad58efbdfcc => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.073015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.175396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33d6bc-ece1-4747-8df5-7748354a861a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.220841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.222202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.222632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.223102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d6fa-26af-4347-b93d-9466bcbe221e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.223269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.224667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.226365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e57c-193c-4345-986c-7b184b46da30 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.229436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 186/374] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.234867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255e70-9fb5-4443-8488-05a8c09a48ed None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.235413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255e70-9fb5-4443-8488-05a8c09a48ed None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.235837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255e70-9fb5-4443-8488-05a8c09a48ed None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.242484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 187/375] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:48.244213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8255e70-9fb5-4443-8488-05a8c09a48ed None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.266214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.267226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.267512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.267789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.286727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:48.309641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:48.367490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.370261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.379255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8255e70-9fb5-4443-8488-05a8c09a48ed None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.423149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.424056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.424338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.424611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.425507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] RBAC: Adding query filter params (role.id=49ad12f713384bd298c9e1a3de23d6e7, user.id=78a2414d935d4eb9b55d3ad58efbdfcc, scope.system=all) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:48.425761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.428076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbc3b7-f7b8-470a-954f-70bcd2ba3cb0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.444130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 188/376] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/role_assignments?user.id=78a2414d935d4eb9b55d3ad58efbdfcc&scope.system=all&role.id=49ad12f713384bd298c9e1a3de23d6e7 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.445693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.445980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.446824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.470912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:48.472566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:48.495517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 189/377] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:48.496800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.569151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 189/378] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:48.570394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.578095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:48.594109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:48.638227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb85c2d-0ba9-4809-a37b-eda9a9eadc10 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.707089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.707641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.707930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.708209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.709027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=116381016511423d811c369b96ef019b) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:48.709370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.711067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.723208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 190/379] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=116381016511423d811c369b96ef019b&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.727056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.753166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348369c0-fb4f-4625-be1c-28b3c8c7bf75 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.855421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.856113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.856403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.856692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] PATH_INFO: `/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.858040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3dbe2c1eb04d9797ed50b9b1752bfa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:48.859517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:48.865770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 190/380] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:48.869775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0027e-6972-41ae-8a09-fef2cf511e0b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:48.870995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:48.927838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:48.943456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:48.944471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:48.945139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:48.945630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:48.961231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:48.968218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:48.969095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:48.969901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:48.972719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 191/381] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:48.979578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.049075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.070021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5c8a0-3253-4e31-9f9a-f06a69c12696 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.109992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378942b5-2cab-4025-93da-6d54b5f4a489 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.117124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.119140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.119607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.120055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] PATH_INFO: `/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.131035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] RBAC: Authorizing `identity:get_group(group_id=4311b8c8900f4c2eb1a9ffd7e8661c70)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:49.132832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922048b-9ae7-46b4-8b46-23d8bff35635 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:49.134919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 191/382] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70 => generated 229 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:49.136444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16e85-7ef5-4671-861a-c3687e32659b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.136925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16e85-7ef5-4671-861a-c3687e32659b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.137447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16e85-7ef5-4671-861a-c3687e32659b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.138848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 192/383] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:49.140728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16e85-7ef5-4671-861a-c3687e32659b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.163973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.165672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.165962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.166241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.167357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:49.167675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:49.169060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373388d-1501-4f84-bd92-a7c76999f943 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:49.187215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 192/384] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:49.188762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.189249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.193618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.214661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:49.216172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:49.271603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.291162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16e85-7ef5-4671-861a-c3687e32659b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.302065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 193/385] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:49.303509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.344457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.345686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.345981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.346260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.347360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] RBAC: Adding query filter params (group.id=4311b8c8900f4c2eb1a9ffd7e8661c70, role.id=37946d08da58471c9678da91450dd183, scope.project.id=7b3dbe2c1eb04d9797ed50b9b1752bfa) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:49.347678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:49.351507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:49.360766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 193/386] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:49 2022] GET /identity/v3/role_assignments?group.id=4311b8c8900f4c2eb1a9ffd7e8661c70&scope.project.id=7b3dbe2c1eb04d9797ed50b9b1752bfa&role.id=37946d08da58471c9678da91450dd183 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:49.362130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.404281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.518547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f6fe2-b44a-46e4-9e62-145c6539060f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.583508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567446e-170d-4aca-bdf2-0f927b4a708e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.589544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.590199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.590481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.590761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.591962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:49.593431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:49.600351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 194/387] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:49 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:49.601251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.651950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.652612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.652900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.653178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.665642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:49.673149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:49.674217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:49.675019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 194/388] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:49.680256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.705966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.800746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86e99-633d-4065-9383-2044bfbefd79 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:49.843850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:49.844501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:49.844787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:49.845062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:49.846587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:49.848300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:49.850366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 195/389] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:49 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:49.859835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:49.887404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.953855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6172a0-8acc-4046-acbf-7d8d443e1d97 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.014624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a6340-c7f2-4130-85f3-b938a7f27015 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.026718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.027361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.027646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.027919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.028643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:50.028950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:50.030367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:50.045626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:50.049166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 195/390] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:50.052595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:50.088235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.089042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.089345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.089625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/groups/49dba16c110c49899337518bec2c5f12/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.094747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, group_id=49dba16c110c49899337518bec2c5f12, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:50.096199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:50.124512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 196/391] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 19:50:49 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/groups/49dba16c110c49899337518bec2c5f12/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:50.201881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b02451-9d7b-40f0-b9b6-4d8d1726781f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.241317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.242000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.242284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.242560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.243823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:50.245330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539490a-0b6f-4e11-943a-e233a5e1edaf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:50.247527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 196/392] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:50 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:50.252842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:50.382156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0121c-c8fb-42ab-8440-31f1f6c0f0a1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.422944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.423603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.423888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.424169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.425397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:50.426847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:50.428867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 197/393] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:50 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:50.433460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b762e2c-de41-46be-9c5d-3f16c10f48d0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.433924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b762e2c-de41-46be-9c5d-3f16c10f48d0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.433924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b762e2c-de41-46be-9c5d-3f16c10f48d0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.435241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 197/394] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:50.436251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:50.441762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.442269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.442649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.458010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:50.480654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:50.481989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:50.490506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:50.557399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c6de-13e9-4fde-8844-be32c88690eb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.605294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.605294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.605294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.605294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/groups/49dba16c110c49899337518bec2c5f12/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.605744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, group_id=49dba16c110c49899337518bec2c5f12, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:50.605744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:50.623968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 198/395] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 19:50:50 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/groups/49dba16c110c49899337518bec2c5f12/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:50.636991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 198/396] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:50.664442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:50.816543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37554c-3f41-41a9-95f5-d8311d702e63 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:50.818580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:50.864090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:50.864760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:50.865042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:50.865340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:50.879224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:50.885160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:50.887812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:50.888585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 199/397] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:50.892578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.017063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c705c-ac6f-4531-8b95-c7fbfdc3a955 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.068595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.069491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.069947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.070368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.071297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:51.071749 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:51.073351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886578-45c4-4618-9dbc-34c508c14811 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:51.075055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:51.085505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:51.091768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.158972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a30e-adfc-4e59-8e0e-4b11a3ed8f97 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.159476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a30e-adfc-4e59-8e0e-4b11a3ed8f97 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.159914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a30e-adfc-4e59-8e0e-4b11a3ed8f97 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.161755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 200/399] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:51.170745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.171239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.171672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.221101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b2396-4daf-4a65-b7c4-82bf5aaef29d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.226053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:51.228000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:51.290783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.291712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.292650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.294005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.296884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:51.298524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:51.307456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:51 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:51.313171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.349681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:51.373962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 201/401] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 19:50:51.398017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.450492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741326-2a15-4ae3-973c-0c5e47dc43dc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.520784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbcdcd-9dd5-4f35-b581-ff51482edc36 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.542536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.543204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.543503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.543784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.550069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:51.551780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:51.553385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:51.553497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 201/402] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:51 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:51.559874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.583319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.583982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.584263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.584542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.606382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:51.611381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:51.612243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:51.613051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 202/403] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:51.618507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.708841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:51.719534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d828c9f-4e77-4e6f-8b3a-f7882497c942 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.743894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245ec4-b343-4007-bc86-4b36a5c805da None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:51.790931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.792380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.794188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.794878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30/groups/49dba16c110c49899337518bec2c5f12/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.800482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd1a24f035542db8609119486e52e30, group_id=49dba16c110c49899337518bec2c5f12, role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:51.802569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:51.817660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:51.818865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.819435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.820094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.821150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:51.824576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:51.826854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189768-d0b8-4504-80b4-4c8a971ae012 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:51.830150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 202/404] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 19:50:51 2022] PUT /identity/v3/projects/0dd1a24f035542db8609119486e52e30/groups/49dba16c110c49899337518bec2c5f12/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 19:50:51.844235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 203/405] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:51.850118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:51.964894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07405de-6b06-499e-8a28-e24500b4283a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.965085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07405de-6b06-499e-8a28-e24500b4283a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.965396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07405de-6b06-499e-8a28-e24500b4283a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.967044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 204/406] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:51.972552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:51.972833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:51.973119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:51.991932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:51.993758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:52.050465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd1b87-4272-4c6d-8e4c-a88c27aa1d92 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.051192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.079283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 205/407] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:52.095911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.096925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.097497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.098001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.099347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.101377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.102097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.103707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 203/408] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:51 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:52.110705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.141576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.210407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2686ebb-01b6-4544-a13d-3369cf9175af None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.228659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f5629-9110-4c64-b114-6e38fb8330e7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.247292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.247951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.248237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.248603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.260721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:52.265581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:52.266425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:52.267188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 206/409] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:52.271686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.272482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.272843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.273192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.273424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.275197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.276705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.279565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 204/410] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:52 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:52.285012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.316698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.403394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.412329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1eed6-b041-4fb4-ab01-f0ed91f35230 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.425185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cddb5-3324-4090-9a7d-25062d2d34fa None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.449856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.450921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.451400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.451872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b/groups/49dba16c110c49899337518bec2c5f12/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.454387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=116381016511423d811c369b96ef019b, group_id=49dba16c110c49899337518bec2c5f12, role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.456039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.471946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 205/411] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 19:50:52 2022] PUT /identity/v3/projects/116381016511423d811c369b96ef019b/groups/49dba16c110c49899337518bec2c5f12/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:52.485456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.486084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.486369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.486646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.487452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:52.487767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.489307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.507900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 207/412] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:52.514549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.658883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dfbbe-20e9-4aa8-94e8-5b1db6df4ba5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.703795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.704824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.705349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.705840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] PATH_INFO: `/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.707240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] RBAC: Authorizing `identity:get_group(group_id=4311b8c8900f4c2eb1a9ffd7e8661c70)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.709099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47bfa-3852-459b-bd03-689a5fe5e1fe None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.711309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 206/413] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:52 2022] GET /identity/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:52.717044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.772625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64bd45-6e8b-46cd-be4c-eb2298e325e1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.772922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64bd45-6e8b-46cd-be4c-eb2298e325e1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.773138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64bd45-6e8b-46cd-be4c-eb2298e325e1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.775070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 207/414] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:52.780062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.780353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.780632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.812380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:52.813610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:52.851520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.872605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f585b-9a2d-4fa6-9021-c6e6a622daf1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:52.877922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:52.918229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:52.919312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:52.919744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:52.920203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] PATH_INFO: `/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:52.921589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3dbe2c1eb04d9797ed50b9b1752bfa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:52.923241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:52.925451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 208/415] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:52 2022] GET /identity/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:52.932891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:52.976264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 208/416] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:53.022081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.065698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbc05e-c347-45d3-8215-4d0ed18cc0d0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.124304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.124983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.125291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.125558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] PATH_INFO: `/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa/groups/4311b8c8900f4c2eb1a9ffd7e8661c70/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.130867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3dbe2c1eb04d9797ed50b9b1752bfa, group_id=4311b8c8900f4c2eb1a9ffd7e8661c70, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:53.132427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:53.138127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de66e-a279-4c52-bbf8-44324efe7b87 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.158713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 209/417] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 19:50:52 2022] PUT /identity/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa/groups/4311b8c8900f4c2eb1a9ffd7e8661c70/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:50:53.180767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.181865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.182355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.182911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.203865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-796ccc01-7cfe-4ab7-9f24-0e37d2daf85b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:53.209926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:53.210862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:53.212253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:53.214803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 209/418] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:53.221052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.269411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.365522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2273d-a7b3-4679-9a35-4b33541e3a8b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.376363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c0de-3644-4050-97af-e2be02ab5e42 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.376888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c0de-3644-4050-97af-e2be02ab5e42 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.376888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c0de-3644-4050-97af-e2be02ab5e42 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.378357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 210/419] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:50:53.389609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.389937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.390165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.417837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:53.419057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:53.427875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.429773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.431022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.431400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.431608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.432333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:53.432639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:53.434069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:53.442952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 210/420] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:53.449212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.521597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:53.554076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.590041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.604800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df20e1-a900-42c0-a92c-881782562619 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.640347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.640895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.641178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.641478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.712376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:53.713870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:53.730573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61c04d-8c97-463c-9967-2a8d926b16f7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.765608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.766262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.766548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.766828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.792516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:53.815614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:53.816120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:53.817104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:53.818078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 212/423] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:53.818699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.823290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.834318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:53.841191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.937393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc0dee-e89f-423d-b02a-a87eaca2056f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:53.990722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59239ca3-47da-417e-900e-0235620c636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:53.991664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239ca3-47da-417e-900e-0235620c636c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:53.993332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239ca3-47da-417e-900e-0235620c636c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:53.993757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59239ca3-47da-417e-900e-0235620c636c None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:53.998505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59239ca3-47da-417e-900e-0235620c636c None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.000096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59239ca3-47da-417e-900e-0235620c636c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.001956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 212/424] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:54.007282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59239ca3-47da-417e-900e-0235620c636c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.052319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078cc8c-2fbb-4346-9103-c97ca8abe6ea None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.112881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.127099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.127740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.128025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.128302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.129029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:54.129358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.130933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.153434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59239ca3-47da-417e-900e-0235620c636c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.157407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 213/425] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:50:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:54.174322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.195035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.196179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.196671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.197247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.198723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.200591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.202780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:54.208051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.292466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.322805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ed20-f0ea-49cb-9863-50c6d64e00cc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.361604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.370212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87dfa2-a8b0-468b-a367-918cf5812e88 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.380420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.381090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.381403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.383000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.383916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=0dd1a24f035542db8609119486e52e30) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:54.384235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.385717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb2f19-113b-475f-bc23-74d62bc34172 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.399893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 214/427] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:54.421931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.422624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.422904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.423225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.513131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.514545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.585342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11062df-0cfc-4e46-a2e1-8bf96a9528ee None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.586009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11062df-0cfc-4e46-a2e1-8bf96a9528ee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.586528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11062df-0cfc-4e46-a2e1-8bf96a9528ee None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.588378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 215/428] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:54.593942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.594516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.595042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.616584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:54.620780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:54.622616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.689054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 214/429] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:54.694756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.741981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 216/430] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:54.768226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.829356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2738-e089-4d65-b9cb-6d0f8bc31bfd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.874468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.875963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.876247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.876524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.885712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:54.885712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:54.885712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 215/431] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:54.890731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:54.901523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc7c9-f978-41d4-a085-b8bcc3c6ce3b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:54.932470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.939927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:54.964616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:54.965361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:54.965635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:54.965924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:54.979628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:54.986394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:54.987253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:54.988029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 217/432] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:50:54.994190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.037045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973247-a644-4dd9-bbaa-b6757de5d3c9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.082868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414896e-3708-4e56-b673-477100d05315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.083526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414896e-3708-4e56-b673-477100d05315 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.084278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414896e-3708-4e56-b673-477100d05315 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.084566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414896e-3708-4e56-b673-477100d05315 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.086180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414896e-3708-4e56-b673-477100d05315 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.088023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414896e-3708-4e56-b673-477100d05315 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.089988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 216/433] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:55.091166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31acf9-0866-47cf-950c-42eac532708c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.091455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31acf9-0866-47cf-950c-42eac532708c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.091735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31acf9-0866-47cf-950c-42eac532708c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.092956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 217/434] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:55.095577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31acf9-0866-47cf-950c-42eac532708c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.117052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19d-f994-494f-9452-d29c30084a1c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.165165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848674d-c280-4277-9717-53aad68722eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.166661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848674d-c280-4277-9717-53aad68722eb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.167124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848674d-c280-4277-9717-53aad68722eb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.167660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848674d-c280-4277-9717-53aad68722eb None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.169090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848674d-c280-4277-9717-53aad68722eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:55.169567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848674d-c280-4277-9717-53aad68722eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.171111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848674d-c280-4277-9717-53aad68722eb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.181520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 218/435] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:55.184617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.185128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.185623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.210630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:55.212132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.213221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:55.216740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31acf9-0866-47cf-950c-42eac532708c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.257352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.257642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.258990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.259270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.259545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.260339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=d4e2d689cd514e8c861f5736930af1d6, scope.project.id=116381016511423d811c369b96ef019b) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:55.260718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.262231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.277693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 218/436] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=116381016511423d811c369b96ef019b&role.id=d4e2d689cd514e8c861f5736930af1d6 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:55.279338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.301799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 219/437] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:55.318387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.426584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c09a-66dd-4990-adc9-12ec1689faea None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.443997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b53eb-dc73-4c0a-a892-252c4371fb84 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.469000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.469735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.470017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.470331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.490547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.491458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.492146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.492431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.505579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.507995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:55.514104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:55.515020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:55.515795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 220/438] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:55.522500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.549401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.550851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0ff8-4da8-4c59-b3e3-ce1451ade688 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.556317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.628314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01d9b2-b42e-4979-bb93-3c47293e8ee0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.653855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 219/439] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:55.655109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827bcb6-8aad-49fe-be9a-5cb79b9f10a7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.655403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827bcb6-8aad-49fe-be9a-5cb79b9f10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.655683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827bcb6-8aad-49fe-be9a-5cb79b9f10a7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.656935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 220/440] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:55.661587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827bcb6-8aad-49fe-be9a-5cb79b9f10a7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.666531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.667150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.667435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.667713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.668436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:55.668744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.670148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca6fda-0c55-4337-b10e-ace64fbe4fde None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.677977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 221/441] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:55.679180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.679473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.679752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.699250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:55.700425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:55.737181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.766102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 222/442] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:55.766934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.783619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827bcb6-8aad-49fe-be9a-5cb79b9f10a7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.791071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.819246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.819821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.820106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.820380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] PATH_INFO: `/v3/projects/0dd1a24f035542db8609119486e52e30` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.821703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd1a24f035542db8609119486e52e30)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.823179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:55.824841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/projects/0dd1a24f035542db8609119486e52e30 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:55.825608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.872291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4b52-aa1b-4200-b1eb-878dbcc3f7fb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.905882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.906515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.906802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.907083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.923276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa962-71aa-4898-8c2e-f19f139a0325 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:55.951819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:55.957247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:55.957920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:55.958205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:55.958484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:55.969007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:50:55.973980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:55.974819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:50:55.975563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:50:55.976146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:55.976222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 222/444] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:55.976222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:55.976983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.000344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.075673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 223/445] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:56.076425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.076969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401385-1fc4-43ef-9bb8-1aa128025657 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.112990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.113727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.114022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.114308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.115483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.116931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.119250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 223/446] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:55 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.119845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.173926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e38b8c-f52f-44ea-92f1-98d7dafce4aa None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.181715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.198795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.209734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.210353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.210639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.210920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.212208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:56.212514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.213976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.222416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635028c-35ff-479e-b22b-f48d0bd652c6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.222532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 224/447] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.223262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.256116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.256760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.257046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.257363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] PATH_INFO: `/v3/projects/116381016511423d811c369b96ef019b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.258568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] RBAC: Authorizing `identity:get_project(project_id=116381016511423d811c369b96ef019b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.260018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.261714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 224/448] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/projects/116381016511423d811c369b96ef019b => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.262472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.321882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda271d8-3176-4fe7-854c-6d8eaa0285b5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.355837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.356453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.356738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.357008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.357832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=0dd1a24f035542db8609119486e52e30) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:56.358146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.359579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.362745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23747-bfc2-4423-8fbc-d8faa2802237 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.365223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 225/449] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=0dd1a24f035542db8609119486e52e30&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.366021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.404268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.415663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.416303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.416586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.416862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.427367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.487105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668832b-01f2-4143-80a3-1a26f556bf83 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.495204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.496731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.526961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.527659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.527896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.528172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] PATH_INFO: `/v3/groups/49dba16c110c49899337518bec2c5f12` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.530457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] RBAC: Authorizing `identity:get_group(group_id=49dba16c110c49899337518bec2c5f12)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.531600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.533331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 226/450] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/groups/49dba16c110c49899337518bec2c5f12 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.539211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.624188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 225/451] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:56.630833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.661640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.664133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85fcb-c81b-4c70-b7dc-7e7695c373aa None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.686606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:56.709588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.710527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.710905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.712580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.712580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] RBAC: Adding query filter params (group.id=49dba16c110c49899337518bec2c5f12, role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=116381016511423d811c369b96ef019b) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:56.713412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.715182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.722503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 227/452] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/role_assignments?group.id=49dba16c110c49899337518bec2c5f12&scope.project.id=116381016511423d811c369b96ef019b&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.752824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250bbf-8b52-4b35-b9f8-f42bd9cfd919 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.802656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.803334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.803622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.803903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] PATH_INFO: `/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.805771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] RBAC: Authorizing `identity:get_project(project_id=7b3dbe2c1eb04d9797ed50b9b1752bfa)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.807270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.809428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 226/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/projects/7b3dbe2c1eb04d9797ed50b9b1752bfa => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:50:56.815046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:56.935025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6379-68ee-4b23-b897-2091de2a9971 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:56.968804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:56.969483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:56.969773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:56.970053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] PATH_INFO: `/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:56.971210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] RBAC: Authorizing `identity:get_group(group_id=4311b8c8900f4c2eb1a9ffd7e8661c70)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:56.972647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30d80-515b-4053-a2ef-2278a3abaf61 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:56.974280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 228/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/groups/4311b8c8900f4c2eb1a9ffd7e8661c70 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:56.980703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:57.077946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:57.084466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb8a9b-24d3-4196-8ee7-dbec0487e99c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:57.118584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:57.119202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:57.119487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:57.119766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:57.120582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] RBAC: Adding query filter params (group.id=4311b8c8900f4c2eb1a9ffd7e8661c70, role.id=37946d08da58471c9678da91450dd183, scope.project.id=7b3dbe2c1eb04d9797ed50b9b1752bfa) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:50:57.120902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:57.122389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95103634-3e66-40fb-878a-e19c8af3cb8a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:57.128102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 227/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 19:50:56 2022] GET /identity/v3/role_assignments?group.id=4311b8c8900f4c2eb1a9ffd7e8661c70&scope.project.id=7b3dbe2c1eb04d9797ed50b9b1752bfa&role.id=37946d08da58471c9678da91450dd183 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:50:59.600659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ec99-e7df-41eb-80f6-f84944eaaf1b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.601170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ec99-e7df-41eb-80f6-f84944eaaf1b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.601245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ec99-e7df-41eb-80f6-f84944eaaf1b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.603356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 229/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:59.608456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5579d-b402-46d5-8bac-23c3516867ac None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.608838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5579d-b402-46d5-8bac-23c3516867ac None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.609018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5579d-b402-46d5-8bac-23c3516867ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.637692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a8d5579d-b402-46d5-8bac-23c3516867ac None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:59.638871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a8d5579d-b402-46d5-8bac-23c3516867ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:59.730914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 228/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:50:59.767644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ec99-e7df-41eb-80f6-f84944eaaf1b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:50:59.828132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d1b5-54a6-4798-bc63-b251cd410271 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.828440 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d1b5-54a6-4798-bc63-b251cd410271 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.828688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d1b5-54a6-4798-bc63-b251cd410271 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.830328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 229/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:59.834183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:59.835801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05337a7-39bf-41cd-9096-a8d0ca701008 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.836111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05337a7-39bf-41cd-9096-a8d0ca701008 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.836427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05337a7-39bf-41cd-9096-a8d0ca701008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.858653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b05337a7-39bf-41cd-9096-a8d0ca701008 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:59.859769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b05337a7-39bf-41cd-9096-a8d0ca701008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:59.904555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ec99-e7df-41eb-80f6-f84944eaaf1b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:50:59.929774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 230/459] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:50:59.931642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18a87-7fc2-4ee4-b8a2-c809af761122 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.931935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18a87-7fc2-4ee4-b8a2-c809af761122 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.932203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18a87-7fc2-4ee4-b8a2-c809af761122 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.933906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 231/460] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:50:59.939261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.939767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.940241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.944239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:50:59.945087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:50:59.945580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:50:59.946043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:50:59.957049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:50:59.958755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:50:59.959078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:50:59.960365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:50:59.976120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:50:59.977650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:50:59.978652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:50:59.979688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:50:59.979688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:50:59.979688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:50:59.979688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:50:59.981595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 230/461] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:50:59.982662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.038215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 232/462] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:00.042133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.111952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539a8c-1833-4aa2-a93c-0974cdebd09c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.113904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.151779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.152664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.153095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.153554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.168086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.170412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.179145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cc6ff-9156-44cc-851a-a371dec03709 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:00.189510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:00.190354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:00.191184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:00.191184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:00.191184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:00.191184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:00.191184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 231/463] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:00.191873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.227698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.228385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.228675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.228954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.229688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:00.229996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.231556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.247263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 233/464] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:00.248163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.263944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.303898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550ac73-0532-4fb8-a8e8-30320f100750 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.340669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.341739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.342229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.342708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.354695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.356473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:00.372149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:00.372978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:00.374138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:00.374138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:00.374138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:00.374138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:00.374551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01be1-2e43-4e92-8141-0fe11fa9b50c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.380849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 232/465] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:00.381992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.391626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.415470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.416106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.416562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.416678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.417414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:00.417725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.419098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.431209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 234/466] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:00.432028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.495528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc423c6-5be8-4ab9-9854-9a92af0a3d52 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.505231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.536543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.537185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.537572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.537826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd6a-0080-4e7c-bb8c-4c52dd6f789e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.537946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.538536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.540807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ed347-92f6-4104-b94e-130ca93b44a7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.573296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 233/467] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:00 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:00.573296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7cc-9562-4322-9445-84e370d21e24 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.573296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7cc-9562-4322-9445-84e370d21e24 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.573637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7cc-9562-4322-9445-84e370d21e24 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.575607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 234/468] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:00.576389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c7cc-9562-4322-9445-84e370d21e24 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.577926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.578561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.578850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.579131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.580180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:00.581530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.582955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203944c-d783-4027-ba3b-4cb391f2f879 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.599930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 235/469] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:00.601373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.602205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.602494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.627550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:00.628881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:00.673733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.734543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 236/470] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:00.735484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.740881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c7cc-9562-4322-9445-84e370d21e24 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.788394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.790030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.790850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.791134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.791823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.794090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.806962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:00.823593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 235/471] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:00 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:00.824726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:00.869600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec8fd-de7f-46c8-a6f2-2c538b77172d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.918557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:00.919330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.919684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.920036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.921130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:00.922928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8b401-b006-425e-82e0-2c361b31e418 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:00.977694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810610df-9b5e-483e-b6a9-6f75fbd2dbd3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:00.980100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 237/472] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:00 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:00.982609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c6a7-30df-473e-a4ae-2865dd7873e2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.982904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c6a7-30df-473e-a4ae-2865dd7873e2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.983186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c6a7-30df-473e-a4ae-2865dd7873e2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:00.984824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 238/473] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:00.991528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:00.991898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:00.993199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.001445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:01.022036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:01.023259 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:01.042025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.042779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.043066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.043373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.061146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:01.063798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:01.082326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:01.083352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:01.084171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:01.084171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:01.084171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:01.084171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:01.086814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 236/474] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:01.092893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:01.125527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 239/475] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:51:01.147988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:01.205462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3964f-fe73-403e-9991-abf47e4161a5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:01.210158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:01.245799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.246793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.247286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.247757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.248660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:01.249159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:01.251052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:01.271069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 237/476] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:01.276516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c599f-8431-439b-a9ed-42a9cb5e8cc6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:01.277609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:01.318960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:01.327723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.328353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.328640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.328917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.329734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:01.331188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:01.346033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.sql.core [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 19:51:01.346033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 19:51:01.346033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [parameters: {'id': '17d67446f2744c2d9168ea5a8d0061bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 19:51:01.346033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:01.366232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:01.367192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application yield resource Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise self.value Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application session.commit() Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 19:51:01.368049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.flush() Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application compat.raise_( Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 19:51:01.369241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:01.370112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:01.370903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [parameters: {'id': '17d67446f2744c2d9168ea5a8d0061bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:01.371669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 19:51:01.373595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.375679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 240/477] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 19:51:01 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:01.375679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:01.420191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cece62-56ab-47ba-954f-b12936a84bee None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:01.459232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.459863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.460146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.460469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.461283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:01.463094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:01.488263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 238/478] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:01 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:51:01.504037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d66fa-9382-4d64-88ac-7ec823d4c8e8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:01.516161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:01.546159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.546824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.547111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.547395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.559155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d6851738-7d9a-4652-a8e8-9b141b0e9f83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:01.564250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:01.565359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:01.566249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 241/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:01.571795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:01.725434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:01.744258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d291b-1c14-41b1-be1b-c9f08e065a74 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:01.779997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:01.780626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:01.780909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:01.781187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:01.781962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:01.782269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:01.783785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9e99b-e310-439b-bf73-5329ee2760e9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:01.792573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 239/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:03.310525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e083-0d24-4e57-b6c9-2c8e436be008 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.311007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e083-0d24-4e57-b6c9-2c8e436be008 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.313065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e083-0d24-4e57-b6c9-2c8e436be008 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.314665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 242/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:03.319720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.320152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.320404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.350265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:03.351484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:03.404146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcdf3-fcd1-4887-a70f-b830074ce9e5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.404477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcdf3-fcd1-4887-a70f-b830074ce9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.404711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fcdf3-fcd1-4887-a70f-b830074ce9e5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.406325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 243/482] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:03.416888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.417208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.417512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.422051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 240/483] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:03.444607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:03.457563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:03.458763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:03.569723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:03.595487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 244/484] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:03.596660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57da40-24fb-4ee6-bd4d-6c4586cc7e76 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:03.619335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:03.656917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:03.657954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.658437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.658914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.675212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-378679a8-448f-4c10-b7cf-a9c61e90adfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:03.681535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:03.682380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:03.683163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:03.685479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 241/485] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:03.686988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100123b2-1898-467b-a850-ac0bc1a094bc None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.687481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100123b2-1898-467b-a850-ac0bc1a094bc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.687986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100123b2-1898-467b-a850-ac0bc1a094bc None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.689480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 242/486] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:03.694472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100123b2-1898-467b-a850-ac0bc1a094bc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:03.731976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:03.734848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253464c-21a8-4f2d-b3d6-e5b78e8aa0b8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:03.771937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:03.772590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.772874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.773153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.783961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-587695cd-797c-4b05-a332-5d4aacbc866c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:03.788872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:03.790261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:03.791074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 245/487] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:03.791744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.791813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.796943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.811764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:03.813073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:03.819344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100123b2-1898-467b-a850-ac0bc1a094bc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:03.856351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:03.857420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:03.857838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:03.858309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:03.859222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:03.859673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:03.861520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:03.870413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:03.876648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:03.877696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:03.889929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 246/489] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:03.897318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:03.982921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:03.994089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec79345-557b-4638-a117-1f4d2aa528df None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.017598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b16aa-a656-40b8-b8a0-1afa8f26db27 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.029235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.030051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.030468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.030843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.046593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.048926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.061070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.061959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.062388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.062808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.063671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:04.064255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.065816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:04.067016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.067952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.068777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:04.068777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:04.068777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.068777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:04.068777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 247/490] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.073670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.083129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 244/491] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:04.084385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.151290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.186698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b0d18-63a6-4eb1-8f75-5fea071173c8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.194403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6054-6370-4ce4-b9c5-eced448932be None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.223120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.223762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.224056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.224337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.230335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.231146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.231605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.232029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.232890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:04.233383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.234903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8a807-47ce-4d35-aa3e-ca882b659f72 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.235365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:04.241458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.242589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 248/492] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.243552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.246088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.256007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 245/493] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:04.257612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86ede-6793-4daf-b808-8799ad9b1905 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.258446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86ede-6793-4daf-b808-8799ad9b1905 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.258724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e86ede-6793-4daf-b808-8799ad9b1905 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.263888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 246/494] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:04.263888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86ede-6793-4daf-b808-8799ad9b1905 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.358515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083af85-3ea4-4ad2-8158-2b6481df909d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.370826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e86ede-6793-4daf-b808-8799ad9b1905 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.393728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f965af-2226-443a-988b-00c065362533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.394738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f965af-2226-443a-988b-00c065362533 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.394846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.394945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f965af-2226-443a-988b-00c065362533 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.394945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f965af-2226-443a-988b-00c065362533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.406233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f965af-2226-443a-988b-00c065362533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.407634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f965af-2226-443a-988b-00c065362533 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.408514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.409172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.409492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.409755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.410478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:04.410848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.412208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.425706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 247/495] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:04.425706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e6f965af-2226-443a-988b-00c065362533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:04.425946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.426676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 249/496] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.427490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.444237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:04.445586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:04.499349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.517894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 250/497] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:04.518724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.551492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e1739-1398-459e-983c-e5d34d43a693 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.584582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.585220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.585546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.585826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.593665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.595130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:04.608124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.609165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.610583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.622440 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b269e-6f4c-4f77-81f1-429f5a3276db None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.654824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.655754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.656445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.656682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.656952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.667737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.669187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-19181a40-8c9c-4ca8-b376-5d39e60cd565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:04.683495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.684491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.685536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:04.685536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:04.685536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:04.685536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:04.685536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.686670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda197da-1515-4d7c-ab22-63b72f3e8c66 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.686961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda197da-1515-4d7c-ab22-63b72f3e8c66 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.687240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda197da-1515-4d7c-ab22-63b72f3e8c66 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.688677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 252/500] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:04.689208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda197da-1515-4d7c-ab22-63b72f3e8c66 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.714579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a24e-ff51-4780-a03d-66d7cf1128ca None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.724494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.747980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.748591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.748874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.749149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.749871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:04.750180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.751554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.764426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 249/501] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:04.765232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.796194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda197da-1515-4d7c-ab22-63b72f3e8c66 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.830053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.830691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.830995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.831256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.841599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-96325a5f-b957-4a66-b29b-6411a0a06f50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:04.846905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:04.847770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:04.848535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 253/502] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:04.849167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.849719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.849719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.869841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e946-f087-4b13-b3d4-b64d4a4e1880 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:04.871809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:04.872854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:04.873007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:04.905372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:04.905990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:04.906272 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:04.906599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:04.907341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:04.907646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:04.909064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:04.939097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 254/503] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:04.939938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.950113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 250/504] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:04.951099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:04.967467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.038701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a6ae0-4c83-4bdb-a686-55590570cdbb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.051056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d0c2-b3e1-4e16-9baa-b0271582ca61 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.073741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.074348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.074628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.074901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.075586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:05.075893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.077288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.085196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.085888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.086205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.086483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.088765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 255/505] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:05.090466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.094320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.095775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:05.108023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:05.108990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 251/506] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:05.110299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.134851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.181696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.197523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214bce2-2baa-4e31-9a50-137929b69558 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.212517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45fb4-31ec-44e2-890d-19e981abde22 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.231306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.231926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.232213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.232494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.233216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:05.233558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.234935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.242747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 256/507] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:05.243528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.252094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.252711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.252993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.253335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.320579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.322084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.341120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3565ec-4cc4-40e6-957e-bd299a390114 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.344670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.380505 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.381151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.381462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.381744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.392138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.393600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.401984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:05.409008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:05.410051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:05.410931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:05.410931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:05.410931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.410931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:05.410931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 257/508] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:05.412576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.429795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 252/509] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:05.430634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.510957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13948b6-d01c-4493-8a28-78320b60f38f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.529889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdbde0-fb0a-43cc-ae3e-488eebf23e5e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.545458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.546099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.546383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.546659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.552574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.554132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.556234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.565071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.565725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.566014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.566293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.567098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:05.567412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.568845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:05.568941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:05.569951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 258/510] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:05.571712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.587165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 253/511] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:05.587980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.633858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.674519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6744e-1c93-410a-a7be-99163975dae8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.687620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7dcf-d53e-4985-b888-4fbdd930ccbc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.708687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.709358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.709638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.709910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.720671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.721756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.722147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.722373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.722661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.722936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.723631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:05.723939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.725313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:05.736262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:05.737110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:05.737961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:05.737961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:05.737961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.737961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:05.738197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 254/512] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:05.738197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.738313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 259/513] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:05.738420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.786626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.839832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c2af-be1a-4758-b37c-c81b52b709b1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.846831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb538e-9677-4edb-a219-e65ab1323238 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:05.852834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:05.876852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.877495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.877776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.878054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.878852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:05.879162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.880596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.885253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:05.885931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:05.886218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:05.886494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:05.897078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:05.898606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:05.912535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:05.913410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:05.914794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:05.914794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:05.914794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:05.914794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:05.914794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 255/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:05.915316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:05.919431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 260/515] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:05.920246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.011934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.016646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb09745-b057-47f8-8621-202dc46a6096 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.021119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffaeb-052d-4763-98ec-bec3aff7eb2f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.050749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.051292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.051575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.051849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.052533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:06.052839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.054285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.054815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.055425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.055713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.055989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.065225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 261/516] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:06.066004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.096225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.123333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.124805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.163833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457b47-1e65-41d9-9ec9-7c8541566a23 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.198153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.198767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.199051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.199328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.200002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.201482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.213954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.223396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 262/517] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:06 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:06.223396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.230136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 256/518] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:06.231305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.326617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.346028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d478009-239e-492d-a866-257e1c4d59ce None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.346919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb43e3e-26e5-4859-ba62-d33995127d21 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.386206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504845-35c8-4423-9241-66e454439058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.387086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.387531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504845-35c8-4423-9241-66e454439058 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.387531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504845-35c8-4423-9241-66e454439058 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.387661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.387724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0504845-35c8-4423-9241-66e454439058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.387794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.387885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.388561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:06.388868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.390311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.403990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 263/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:06.404798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.458071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.470919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0504845-35c8-4423-9241-66e454439058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.473150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0504845-35c8-4423-9241-66e454439058 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.511591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ea2e6-c6d8-47b5-af34-ad963c454af3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.549831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.550483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.550766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.551053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.559946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.561442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:06.574109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:06.575221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 264/520] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:06.581631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.590304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.599185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 257/521] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:06.599185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504845-35c8-4423-9241-66e454439058 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.696438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.696859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d1d2-1878-4ed9-b497-58bcd22deb46 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.707669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0504845-35c8-4423-9241-66e454439058 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.733376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.734188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.734480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.734761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.745937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.746619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.746726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.747017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.747363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.748134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.754791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.756008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:06.765537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:06.766578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:06.767602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:06.767602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:06.767602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:06.767602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:06.767602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 265/522] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:06.768074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:06.772343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:06.773883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:06.774771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 258/523] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:06.775356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.835375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:06.887522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dff4e5-4c4b-469a-95b8-51372cff8a6c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.896200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc596-a67f-4992-a426-3331f2068567 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:06.924637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.925502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.925917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.926204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.927007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:06.927322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.928784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.934364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:06.935220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:06.935682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:06.936147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:06.946621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 266/524] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:06.947501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.952849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:06.954579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:06.971584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:06.972464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:06.973310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:06.973310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:06.973310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:06.973310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:06.973310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 259/525] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:06.973678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:06.979516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.062485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967827a-b1dc-401d-8892-3756789bb84f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.081589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.083082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ce45-0a3e-42f0-a2f5-279012ff8d9b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.103793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.104345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.104631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.104912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.105639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:07.105950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.107347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.118981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 267/526] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:07.119788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.127701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.129141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.129696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.130191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.131611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:07.132517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.135303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.164184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 260/527] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:07.164184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.232714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.232901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec02f-1363-4684-aa32-4ee05d1717b0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.269014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.269672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.269959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.270471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.273312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3c68-96b0-48a0-9a6f-3883b3ead5fb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.310559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.311199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.311484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.311757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.312458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:07.312768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.314631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.319248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.331299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 261/528] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:07.331299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.349076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.350655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.448546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4854cdb-5cd4-46c2-8699-b44f471dc141 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.464474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 268/529] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:07.464474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.479875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.492834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.493517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.493803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.494094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.501992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.503470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:07.516954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:07.518021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 262/530] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:07.524236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.566089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.591546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613df8d-8d96-4036-a7f0-8f59befa0099 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.625284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d60c-e77a-44b1-ab16-ee373a521cf6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.627021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.627658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.627940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.628220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.629020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=10705bb480e94b7484e5a3a4983a7cbd) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:07.629372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.630812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.636655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/role_assignments?user.id=10705bb480e94b7484e5a3a4983a7cbd&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:07.637544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.678534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.679311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.680198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.680631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.690544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.692279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:07.710388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:07.711780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:07.712606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:07.717316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 263/532] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:07.718337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.778883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.795272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1b5c7-f267-49c8-8015-a726491a7da2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.846951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d30a-50b0-460e-a508-fceceb705e51 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:07.850786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.851748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.852243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.852727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.863580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:07.867899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.869749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:07.889493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:07.890596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:07.891612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:07.891612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:07.891612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:07.891612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:07.897355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 270/533] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:07.899255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:07.904051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:07.905015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:07.905567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:07.906044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:07.907055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:07.907567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:07.909293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:07.924071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:07.925398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.035411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd730bb2-7162-4d31-8cee-f3d9d2e8e97a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.041161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552163-4afe-4dfd-92b6-65d0e497849e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.043999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:08.081497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.081827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.082409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.082695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.083115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.083232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.083697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.083893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.084214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.084555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.085764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.085950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.086456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.088171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.101176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 265/535] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.102996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.113059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 271/536] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.114254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.184567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:08.237814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430f4f-e56d-40aa-aa44-29e92cb5222f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.239258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba37c5c-2061-42c5-bd92-a1abf7dadb1a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.280405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.281568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.282071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.282543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.286363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.286941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.287229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.287510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.288317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.288635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.290472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.292168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.294130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.301300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 266/537] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.301300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3ccce91f-5718-4203-a0d2-2453631bb865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:08.314562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:08.315448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:08.316341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 272/538] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:08.317461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613621-fd2a-4099-a99b-f96e8c854403 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.317749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613621-fd2a-4099-a99b-f96e8c854403 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.318028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613621-fd2a-4099-a99b-f96e8c854403 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.319563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 273/539] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:08.324528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87613621-fd2a-4099-a99b-f96e8c854403 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.341655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:08.446176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4c1c-39e3-4612-8022-29a91afdab6f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.446516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87613621-fd2a-4099-a99b-f96e8c854403 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.464643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:08.488692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.489540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.489901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.490247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.491112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=7e0f106ea63a4aa781ad03d7583abd89) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.491513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.493711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df05d-4085-4b2f-aa41-6630579b4bc7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.500678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.502020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.502512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.503016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.504000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.504523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.505592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 267/540] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/role_assignments?user.id=7e0f106ea63a4aa781ad03d7583abd89&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.506645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.507103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.507455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.508293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.527975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 274/541] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.529944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.546745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:08.548014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:08.691118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 268/542] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:08.701128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea711e0-8a0e-4830-9b7e-481060a5fe90 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.725824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:08.744935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.745703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.746089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.746377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.747181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=ae9a68a43b80458caf2e622129508c5c) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:08.747498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:08.749087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:08.755625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:08.756445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 275/543] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/role_assignments?user.id=ae9a68a43b80458caf2e622129508c5c&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:08.875484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ba779-cd78-4e16-a87a-7a6055824c8d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:08.926145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:08.926846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:08.927134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:08.927416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:08.943349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:08.950174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:08.951109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:08.952348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 269/544] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:08.957413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:09.001954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:09.079082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80303c94-1b05-48ee-83a8-76fc97f2db62 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:09.126087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:09.126641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.126989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.127273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.127993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:09.128308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:09.129732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:09.140606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 276/545] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:09.146191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:09.260259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:09.281697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276510b0-575f-4063-8566-5726ea571f8c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:09.328801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919da90-216c-415a-9925-063cffc63254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:09.329486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919da90-216c-415a-9925-063cffc63254 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.329779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919da90-216c-415a-9925-063cffc63254 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.330057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919da90-216c-415a-9925-063cffc63254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.341979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919da90-216c-415a-9925-063cffc63254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:09.343459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919da90-216c-415a-9925-063cffc63254 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4919da90-216c-415a-9925-063cffc63254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:09.358962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:09.359835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:09.360807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:09.360807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:09.360807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:09.360807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:09.360807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 270/546] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:09.366063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:09.498911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:09.505656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3732-d32d-4cc1-8f75-13ff2ffc7752 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:09.562922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:09.563553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.563839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.564123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.564825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:09.565134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:09.566555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:09.582462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 277/547] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:09.588602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919da90-216c-415a-9925-063cffc63254 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:09.722770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919da90-216c-415a-9925-063cffc63254 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:09.757530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:09.758102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.758383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.758657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.760643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:09.767537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:09.769056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b36df5cc-aeaf-44af-a979-0f97de720c05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:09.783051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:09.783967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:09.785841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 271/548] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:09.790204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:09.890085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e591-05a0-40c2-9e39-19ef8cac9af4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.890375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e591-05a0-40c2-9e39-19ef8cac9af4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.890657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e591-05a0-40c2-9e39-19ef8cac9af4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.892013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 272/549] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:09.902829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:09.903135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:09.903388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:09.946317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:09.947532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:09.968393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16533-48aa-47a6-88e6-14780f4bc8b5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.006609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.007674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.008173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.008675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.009706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:10.010676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:10.012520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:10.031969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 278/550] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:10.037976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.067689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.116184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 273/551] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:10.162424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.212020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892156-a455-4abc-8797-a279835c9090 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.270726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca31ec-e158-47d4-9724-d7beafe549f1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.297172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.307609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.308250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.308536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.308835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.311484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.312298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.312725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.313215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.324937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:10.330224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:10.331324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:10.332473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:10.334876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 274/552] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:10.342411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.449983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:10.451509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:10.481637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.540455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e4ce-c3cf-490d-b714-01f4d4574642 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.580319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.580951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.581238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.581562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.582584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:10.582899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:10.584354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:10.595024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 275/553] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:10.600720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.650123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.696279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 279/554] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:10.702731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.735019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1440f-7937-4dc8-950a-4a1247caa447 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.769801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.770790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.771284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.771781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.783691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:10.785490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:10.806523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:10.807495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:10.808319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:10.808319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:10.808319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:10.808319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:10.820765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 276/555] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:10.829313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:10.872813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eba7c-71a2-4b69-8581-1a901309aab5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.901534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.921767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:10.922419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.922871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.923151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.936221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:10.938320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:10.954871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:10.958385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7802-bdc6-42c4-98e9-8cd2d187cac3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-19d20014-5f9d-4502-a028-a5800d1b3daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:10.958517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:10.959511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 280/556] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ee66d-ac2a-46b8-b1c2-891a3720262f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.961793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ee66d-ac2a-46b8-b1c2-891a3720262f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.962179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ee66d-ac2a-46b8-b1c2-891a3720262f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.967478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 281/557] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:10.967478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e00e-55ee-4bec-b0b0-d7bb1ab5dedb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:10.967478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e00e-55ee-4bec-b0b0-d7bb1ab5dedb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:10.967478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e00e-55ee-4bec-b0b0-d7bb1ab5dedb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:10.969398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 282/558] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:10.970825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7e00e-55ee-4bec-b0b0-d7bb1ab5dedb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.008001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.008690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.008978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.009256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.010005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.010318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.011717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9bb4e-7df4-4091-ba6f-e5e8cb5c85d2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.030275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 277/559] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:11.031678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa149ca-399d-47a8-b4bf-f07b58ada68e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.032088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa149ca-399d-47a8-b4bf-f07b58ada68e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.032378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa149ca-399d-47a8-b4bf-f07b58ada68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.051576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0fa149ca-399d-47a8-b4bf-f07b58ada68e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:11.052778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0fa149ca-399d-47a8-b4bf-f07b58ada68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:11.076048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7e00e-55ee-4bec-b0b0-d7bb1ab5dedb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.114449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.115090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.115408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.115814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.116871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.117515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.119360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.133466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 278/560] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:11.133466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.133466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.133466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.145091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 283/561] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:11.145880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:11.146062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.147151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:11.178054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.221685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 279/562] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:11.230620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.253513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.259968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb0b8-4806-4237-bc3c-777c0f65ad18 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.296180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.296831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.297120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.297444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.305366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.306946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:11.318922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:11.319868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:11.320848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 284/563] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:11.322213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.347565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ee6a8-81f1-43af-8a78-a0c50f9d88cd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.386636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.387554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.388059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.388502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.396250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.397855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:11.409907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:11.410806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 280/564] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:11.411802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.416485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.429025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9712c3-9077-4639-874e-7664873d9992 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.463368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.464005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.464287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.464558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.475046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:11.481028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:11.481956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:11.482784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:11.485435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 285/565] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:11.486277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.496207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.519258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037fce-9087-4ee9-9daf-e48dc409445e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.553480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.554127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.554935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.555213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.565623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-65f05808-db86-4692-a2b3-58f0553673c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:11.571559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:11.572487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:11.573348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 281/566] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:11.574375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb1c-83da-4ac8-a712-100ac89ee5cb None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.574648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb1c-83da-4ac8-a712-100ac89ee5cb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.574968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eb1c-83da-4ac8-a712-100ac89ee5cb None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.576316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 282/567] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:11.576923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eb1c-83da-4ac8-a712-100ac89ee5cb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.592975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a2538-9675-42e8-b68d-b1dec8eb848a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.627291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.627844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.628125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.628401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.629217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.629551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.630975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.647764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 286/568] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:11.648690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.657661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.684079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eb1c-83da-4ac8-a712-100ac89ee5cb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.716459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.717076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.717399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.717674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.718426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.718739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.720185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.727227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.732672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:11.733493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.748791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dddf0f-28c7-4d24-bffa-dc31a219bb73 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.781176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.781841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.782127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.782514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.783139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.783454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.784807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04845f1d-af28-4003-9dc1-b678a6264f03 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.793431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 287/570] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:11.794573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.794863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.795143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.813649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:11.814860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:11.833748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4accc8-2816-4c1d-a390-cfa7e73c0edb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.869761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:11.870381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:11.870663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:11.870935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:11.871643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:11.871967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:11.873341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:11.875942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.881348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 288/571] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:11.882110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.885307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:11.885421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:11.952299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:11.993113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f60f99-af28-40a3-8ebe-7df1eb1750ad None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:11.993609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5a1d-5c76-4473-a3b9-ef0e1136cb1e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.026403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.026845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.027022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.027309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.027479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.027592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.027762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.028038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.028380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=d44c1c7b81af41e5a016950b3aeb8589) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:12.028732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.030195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.035536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 285/573] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/role_assignments?user.id=d44c1c7b81af41e5a016950b3aeb8589&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:12.036312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.038267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.039802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:12.061021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.062203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.063090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:12.063090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:12.063090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.063090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:12.065648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.067009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.123128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.164657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa09c8-110e-4ded-ad1c-561af9f3d3ad None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.186870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71104c-b685-40a8-9070-99ebb797a2c7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.193478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.205509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.206164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.206448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.206724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.218295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.219835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.221228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.221921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.222206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.222489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.233043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.234532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:12.234992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.235828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.236690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:12.236690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:12.236690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.236690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:12.236690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.236980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:12.255630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.256542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.257526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:12.257526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:12.257526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:12.257526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:12.257526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.258275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.355925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb872e-0cc1-42b7-9c24-ddee4b50f8bb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.361663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3157f-a890-4e6f-904e-1756501811e5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.363367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.394555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.395590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.396109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.396576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.397891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.398548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.398963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.399248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.400258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:12.400571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.401964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.407997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:12.415104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.415969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:12.416775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:12.417405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 291/577] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:12.417405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.423218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.423218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.460435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.535558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c5015-64ba-4768-bd18-a64290291caf None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.539455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c748e-6bcf-4120-bd97-edf376fdf218 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.572034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.572656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.572937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.573210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.574146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:12.574452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.574967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.575588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.575818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.575973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.576216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.576938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:12.577255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.578636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.588805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:12.589840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.593400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 292/580] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:12.593400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.618664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.696224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.698972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899ad51-67ce-43be-b223-3b99f9385a38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.702884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846e75-1aec-458f-8e14-18f17dc90ed0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.736102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.736733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.737018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.737390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.738031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:12.738344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.739708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.739808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.740392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.740679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.740953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.747844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.752847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 293/581] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:12.752847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.753393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:12.765670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.766739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:12.767835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:12.768774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 289/582] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.769431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.849112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:12.870214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd00d-5c94-4eb9-a5dd-cae18062b50b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.883411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193d78-24a8-44c7-8b70-f6f841031c69 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:12.907646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.908487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.908875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.909253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.918441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.919957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.924163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:12.924972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:12.925355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:12.925711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:12.931814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.932934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:12.933976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 294/583] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.934561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.939775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:12.941393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:12.957190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:12.958331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:12.959461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:12.960233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 290/584] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:12.961627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:12.980510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.047190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ec74-d644-491e-a777-bf8646d895c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.074148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712f2f9-9f57-4886-a8ee-b5d3440b89b5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.083867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.084831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.085294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.086131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.097737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.099199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.102387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:13.115837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:13.116946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:13.118049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:13.118049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:13.118049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.118049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:13.118855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 295/585] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:13.119490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.124782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.125459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.125750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.126028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.126797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:13.127109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.128545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.147938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 291/586] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:13.147938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.234890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.235312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c917f-ff8e-4d57-9025-4884c1aa8bcd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.259377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642b98-5397-478b-81dc-697f16b4704a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.271584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.272196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.272480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.272761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.274426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:13.274984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.276425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.294907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 296/587] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:13.295892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.301870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.302506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.302787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.303060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.303864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:13.304207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.306062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.333413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 292/588] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:13.334258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.356173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.402669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458033fe-abc7-4c8c-accc-435140c98d78 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.438315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312f3cd-bd53-45be-8f5b-c8c8359b4488 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.438506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.439226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.439617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.439962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.440732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:13.441111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.442591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.454192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 297/589] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:13.454805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.481588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.482516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.483049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.483474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/10705bb480e94b7484e5a3a4983a7cbd/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.486523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.501574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=10705bb480e94b7484e5a3a4983a7cbd, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.503021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.516865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 293/590] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:13 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/10705bb480e94b7484e5a3a4983a7cbd/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:13.517618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.593343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e9e19-e89b-4732-a387-f16a8a4f8cc6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.614609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.645046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f53444-8fe3-4f3d-b5ff-f14b6c52ac50 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.649095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.650132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.650624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.651143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.668229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.670380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:13.690368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:13.691464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:13.692601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:13.692601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:13.692601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.692601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:13.692601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 298/591] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:13.692944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.703360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.704809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.704809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.704998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.716981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.718656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:13.735276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:13.736483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:13.737671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:13.737671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:13.737671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:13.737671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:13.740982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 294/592] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:13.740982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.789455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.810602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d9e54-951e-44fd-b36a-023af7c1c29f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.860603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.861255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.861561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.861838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.871872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.873317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.874726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67780f8c-6e62-419d-9f3a-2d6905141458 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:13.885516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:13.886431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:13.887330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 299/593] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:13.887902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:13.919422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:13.924846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:13.925846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:13.926335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:13.926944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:13.927971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:13.928564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:13.930800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:13.944345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 295/594] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:13.945627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.004774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5db9-830f-4814-8f59-37bddc573dd2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.050571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.051311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.051666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.052048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.052817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:14.053195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.056018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.061624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.067896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedf6d7-2cf7-4916-b875-b47fd3c428b9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.069732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 300/595] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:14.070559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.111053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.111685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.111965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.112237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.113026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:14.113849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.115623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24844f-26a8-4ea4-8656-bfd1e8270c02 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.134134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 296/596] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 19:51:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:14.135585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9d-a69d-47ce-9935-66d4094fe9fe None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.136077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9d-a69d-47ce-9935-66d4094fe9fe None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.136578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9d-a69d-47ce-9935-66d4094fe9fe None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.138034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 297/597] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:14.138928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343c9d-a69d-47ce-9935-66d4094fe9fe None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.169334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.194203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c354-0816-4e7d-baa8-86272e74f3db None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.230114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.230915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.231197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.231471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.238563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.240188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.251181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343c9d-a69d-47ce-9935-66d4094fe9fe None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:14.251679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:14.252521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:14.253396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 301/598] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:14.254563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.292629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.293200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.293511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.293788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.300721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.302203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f99faf0a-64f9-4d2b-965e-16a18a935075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:14.314602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:14.315433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:14.316305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 298/599] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:14.317355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.317355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.317475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.337841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:14.339696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:14.353436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.366239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d754-e89f-4cb0-93ae-249ba6fcb0bc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.404816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.405601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.405957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.406245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.421423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 299/600] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:14.421423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.422674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.424133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:14.439942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:14.441051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:14.442269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:14.442269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:14.442269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:14.442269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:14.442532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.446139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 302/601] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:14.446982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.543898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfb02c-9881-4341-8954-b4d3a78cc09a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.550783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f018-ea7a-4672-b790-ec3c415fc747 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.585235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.586319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.586448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.586730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.586921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.587021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.587205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.587484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.587743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:14.588054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.588517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:14.588834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.589511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.590270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.602025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 303/602] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:14.602841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.614095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 300/603] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:14.614291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.617873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.678024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.723411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6a16-1186-470e-a49c-9590bc8de774 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.727663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b597c7-a19f-4dbd-b3eb-c4b739605a32 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.760923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.761592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.761873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.762144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.763779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.764632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.765118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.765628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.766520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:14.767012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.768805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.772417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:14.777776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:14.778693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:14.779513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 304/604] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:14.780209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.787481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 301/605] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:14.792686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.861943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.896494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a978d8-9df0-4eba-a496-c428591d085a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.901244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957aab6-bede-4edc-b350-4e20928ed165 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:14.914260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:14.934757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.935433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.935720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.936003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/7e0f106ea63a4aa781ad03d7583abd89/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.944457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:14.945779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:14.945995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:14.946280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:14.951646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=7e0f106ea63a4aa781ad03d7583abd89, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.953098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.962528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=be490d99a6d94f5ead55b8d35019ec9e, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:14.963965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:14.966993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 305/606] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:14 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/7e0f106ea63a4aa781ad03d7583abd89/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:14.967836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:14.997965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 302/607] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:14 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:14.999410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.147027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609cdf-e06d-438e-a246-b0f9d15a2bde None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.172558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:15.201907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c73e-4b6b-4756-988b-f1ebaac02c10 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.212226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.213302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.213795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.214277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.224450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.227563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:15.243961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:15.244875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:15.245863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:15.246974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.247098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 303/608] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:15.249405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.249405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.249405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.249405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:15.249405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.251487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.254504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.259992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 306/609] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:15.265232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.309589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:15.392748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca5e1-cb06-4245-bdfc-bace5acedf26 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.407529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e5631-b96a-42f0-94a9-649676593ad0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.440949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.442605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.442605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.443424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.444187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:15.444499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.448629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.451195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.451843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.452128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.452459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.471384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.472849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.478437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 304/610] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:15.485236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:15.504118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:15.505038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:15.505948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:15.505948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:15.505948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:15.505948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:15.506956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 307/611] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:15.513229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.565664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:15.627161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:15.649593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de260f8-9978-4da3-a457-d1cfedae973d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.674086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac08df-3f60-40a4-98ab-e82d284d0fc0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.692926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.693581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.693866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.694143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.694866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:15.695175 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.696549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adb9e4-d7c0-45f8-9486-0455f094de78 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.713813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.714451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 308/612] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:15.714567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.714758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.715040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/ae9a68a43b80458caf2e622129508c5c/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.715806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0563e-f450-49c8-977a-4e5e4b84d54a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.716098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0563e-f450-49c8-977a-4e5e4b84d54a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.716378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0563e-f450-49c8-977a-4e5e4b84d54a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.717969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 309/613] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:15.718678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0563e-f450-49c8-977a-4e5e4b84d54a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.731419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=ae9a68a43b80458caf2e622129508c5c, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.732872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc44edd-996e-4d81-8625-88d7e32a6252 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.747788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 305/614] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:15 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/ae9a68a43b80458caf2e622129508c5c/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 19:51:15.749092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.749445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.749778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.770632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:15.772007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:15.836411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0563e-f450-49c8-977a-4e5e4b84d54a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:15.854607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 306/615] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:15.882710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.906920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:15.915953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:15.916695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:15.916884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:15.917164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:15.936819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:15.938242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:15.964565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:15.965561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:15.966470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:15.972276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:15.975172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:16.034419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b7b0-28bf-4f96-9d22-356c4a1dde3a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.111695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.112351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.112634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.112911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.121340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8c684-6ba6-42fc-828b-094a7ee4583e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.136352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:16.142585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:16.143474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:16.144304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:16.144913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 307/617] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:16.151898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.222140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.222701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.223017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.223269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.224085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:16.224389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.226408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.238840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:16.253296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 311/618] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:16.262472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.276896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79526-706a-4d7a-a0c3-47369a7fb28a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.328803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.330586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.332213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.332698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.335666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:16.336187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.337850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.355070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 308/619] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:16.361875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.372356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:16.418589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355b2f0-7e8e-427e-876d-31536847d02c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.456590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.458214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.458764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.459246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.472107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.474128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:16.509008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:16.510116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:16.510957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:16.510957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:16.510957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:16.510957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:16.512844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 312/620] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:16.518588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.569201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec1c7-b905-4f29-8c77-b9f337d4ea9b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.646426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.647090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.647377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.647658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.659081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:16.679818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710cf78-b798-4289-9ceb-7422d1d84438 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.682312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.684742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.694146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:16.721460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:16.722385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:16.723251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:16.723251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:16.723251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:16.723251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:16.723251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:16.724753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.725642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.725746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.726242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.726713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.727625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:16.728141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.735643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.764417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 313/622] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:16.771360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:16.898847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1df71-d4ec-4a6b-ae86-bd9f00593d55 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.913751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf59e-2c4d-418a-b6f9-c812b7f9ba4c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:16.949312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.950923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.951868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.952352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.962906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.964939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.966337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:16.967208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:16.967729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:16.968199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:16.969124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:16.969658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:16.971268 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:16.991339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 310/623] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:16.997294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:16.998182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:16.999038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 314/624] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:16.999544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.006219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.051917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.089671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.145044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486491d-4aa9-469e-b311-020eb8545fcd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.217373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.218398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.218921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.220151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.223633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa60de0-9e19-4fe7-a03b-314fa506ff98 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.233419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:17.239748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:17.256507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:17.257551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:17.258508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:17.269018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:17.272473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.299345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.300369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.300877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.301377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.302325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:17.302832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:17.306713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:17.331565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 315/626] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:17.337918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.442277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47a5e-867d-4767-9ecc-d6ce4b5e9ca4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.461632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.474151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.486198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde862-1430-4ff8-a285-d6c66073fb3a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.488718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.489764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.495234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.495595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.496494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:17.496882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:17.499364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a5e82-fa7a-4b87-b35f-95b90b85d207 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:17.524706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 312/627] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:17.526266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07811-c4f0-4c70-82ac-fda834497d0b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.526719 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07811-c4f0-4c70-82ac-fda834497d0b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.527187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07811-c4f0-4c70-82ac-fda834497d0b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.529164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 313/628] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:17.530110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07811-c4f0-4c70-82ac-fda834497d0b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.539110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.540115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.540407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.540691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/d44c1c7b81af41e5a016950b3aeb8589/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.558241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=d44c1c7b81af41e5a016950b3aeb8589, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:17.559866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdbe89-91af-4705-b8c2-ab658a6dd82e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:17.574278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 316/629] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:17 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/d44c1c7b81af41e5a016950b3aeb8589/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:17.575607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334663f1-e58d-44d5-b9d0-3fbf4dc1cb09 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.575951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334663f1-e58d-44d5-b9d0-3fbf4dc1cb09 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.576234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334663f1-e58d-44d5-b9d0-3fbf4dc1cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.598624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-334663f1-e58d-44d5-b9d0-3fbf4dc1cb09 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:17.599661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-334663f1-e58d-44d5-b9d0-3fbf4dc1cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:17.669917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07811-c4f0-4c70-82ac-fda834497d0b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.683733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 317/630] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:17.685551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a128a3-5fda-4ca0-b163-1baf2fe1e803 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.686047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a128a3-5fda-4ca0-b163-1baf2fe1e803 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.686518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a128a3-5fda-4ca0-b163-1baf2fe1e803 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.692344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 318/631] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:17.695300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.695859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.696335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.717081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.717773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.718056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.718334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.732301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:17.736584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:17.758431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.802293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:17.804220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:17.820184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 319/632] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:17.820184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.821044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:17.923086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b950a-ae96-4011-8598-81e6d752ab2e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:17.953058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 314/633] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:17.955007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:17.957614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:17.958164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:17.958448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:17.958724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:17.970169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:17.975196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:17.976173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:17.977469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:17.981442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 320/634] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:17.982196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.033779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.045546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.072874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a258-dc8c-4290-b406-dd4447f637e3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.086508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af7d7-d814-49c2-95f6-a04972ba4230 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.110794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.111839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.112336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.112879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.121765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.122404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.122888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.122994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.126185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:18.131432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.132572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:18.133677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:18.134475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.135550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.135658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 315/635] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.136450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-237a2ec6-ac2f-42c3-8f31-ba5844377970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:18.154894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.155992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 321/636] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86553-be1c-47ee-a88d-31b213acd054 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86553-be1c-47ee-a88d-31b213acd054 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e86553-be1c-47ee-a88d-31b213acd054 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.161343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 322/637] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:18.161881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86553-be1c-47ee-a88d-31b213acd054 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.256006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a21ae7-c1d0-48d4-a0a3-f14bf33122c3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.275985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e86553-be1c-47ee-a88d-31b213acd054 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.286110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.291784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.297600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.298642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.298947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.299229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.300248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:18.300562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.302619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.317235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 316/638] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:18.317434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.317434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.317709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.317795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.317795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.317795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:18.317795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.317795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4bcf-f9cf-4524-b0d9-2c2ae65b8825 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.325997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 323/639] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:18.330584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.330584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.330584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.345353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:18.346541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:18.421048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 324/640] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:18.422132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.438263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567f87-ffe1-4687-80cb-dae2efb25f09 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.481175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.481866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.482154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.482433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.483219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:18.483542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.484934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.502285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 317/641] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:18.502285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.543318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e1767-4462-44db-86bf-70f1cfa2f033 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.551434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.556972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.579617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.580187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.580474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.580746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.592502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.594172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:18.612491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.613402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.619011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:18.619011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:18.619011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.619011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:18.619238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54580dac-8dc2-48b6-97b6-d1b2a3a35933 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.619311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 325/642] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.619311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.648849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.649520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.649805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.650086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.659968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.661460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:18.677144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.678161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.679575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:18.679575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:18.679575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:18.679575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:18.679575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 318/643] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.679864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.739050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90110b99-289b-4101-92f2-46210242b0d4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.776169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.777049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.777539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.777818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.787531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.789446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:18.791845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7775a23-9111-4db1-b090-36c82c273156 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:18.795335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.796373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 326/644] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.797239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.817766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:18.834043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.834753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.835045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.835897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.842905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.844347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:18.856369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:18.857228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:18.858154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 319/645] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:18.858644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.911253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd7c3-7543-4cfd-a00e-9f12eaff35d5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:18.945794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:18.946147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:18.946445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:18.946713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:18.947411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:18.947923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:18.949083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:18.963945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 327/646] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:18.966556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:18.972950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a3198-fbe0-49e2-8f0d-ac0a8cb3cfa8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.007725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.008380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.008662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.008939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.009676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.009985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.011370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.023556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 320/647] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.024367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.048884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.063480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.088015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf4d0-a36b-46ae-87a6-5511ef929a8e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.124708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.125378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.125664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.125946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.126662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.126971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.128396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.131221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1d5f1-8bdf-4dd3-890f-fd1b4d13cd7e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.137153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 328/648] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.138028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.170741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.171687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.172169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.172621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.173575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.174090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.175526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.189227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 321/649] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.189898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.251246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7038d-3846-416e-9a25-23aee0aaad26 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.275681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.290160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.290810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.291094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.291377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.297999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddb10e-4eae-4861-b0eb-f31e51c682c8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.300060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.301536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.304184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:19.313834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:19.314941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 19:51:19.316166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:19.320423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 329/650] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:19.321303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.343595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.344449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.344895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.345455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.354279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.356116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:19.368600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:19.369648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:19.370554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 322/651] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:19.371123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.429186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8d3b-c7fe-46e5-a720-04f5e8c691c9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.464135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.464782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.465060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.465412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.478015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77412f-536e-45ba-a91a-748cec809c56 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.480066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.482350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:19.499292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:19.500256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 330/652] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:19.506004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.512579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.513231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.513540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.513811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.514606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=10705bb480e94b7484e5a3a4983a7cbd) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.514918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.516347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.533355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 323/653] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/role_assignments?user.id=10705bb480e94b7484e5a3a4983a7cbd&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.533355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.533355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.583764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.638029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df144d96-9859-4a9c-9fb3-a7fafc77f012 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.649893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfae90-93af-4862-a2ba-c47701903f6a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.676237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.677033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.677336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.677610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.678418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.678728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.680232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.689817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.690452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.690735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.691013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.691815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.692119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.693580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7623-aada-483f-88a5-6c3f9b88af46 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.701235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 331/654] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.701235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.717596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 324/655] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.718878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24f5c-bf75-41b9-b055-09f8b1f007f8 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.719167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24f5c-bf75-41b9-b055-09f8b1f007f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.719806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24f5c-bf75-41b9-b055-09f8b1f007f8 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.721356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 325/656] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:19.721356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24f5c-bf75-41b9-b055-09f8b1f007f8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.792292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.827048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1094e-a5fb-4fa5-942c-75c4f32650fa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.838898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:19.842507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24f5c-bf75-41b9-b055-09f8b1f007f8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:19.869020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.869928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.870208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.870482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.871171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:19.871475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.872988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.882718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:19.882718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:19.882718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:19.882718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:19.889720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 332/657] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:19.890569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:19.956828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:19.958403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3f2bd-01e0-4ee1-a1b5-e8b7fbd2136f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:19.997698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeee2be-0ab3-4aaf-bee3-e3bf4fe3f877 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.022199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.034665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.035294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.035580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.035859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.070735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 326/658] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:20.070735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.070735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.070735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.084783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.085922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:20.087088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:20.119179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.120656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.169684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 327/659] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:20.169684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.232353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 333/660] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:20.233719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.282565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.293435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa85ab-d6ff-4606-a17e-c55341d7957c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.303588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.331281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.332045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.332396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.332668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.334777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66696-8601-45d3-b282-3bbf01fee686 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.340428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.341961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:20.353901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:20.354906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 19:51:20.355896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:20.359608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 328/661] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:20.360425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.372669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.373346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.373840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.374125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.384781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.386260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:20.401745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:20.402606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:20.403452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:20.403452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:20.403452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:20.403452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:20.403452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 334/662] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:20.403731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.472584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8646a-7d7b-4af2-a9aa-4b6b05b92d50 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.507527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.508163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.508442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.508715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.511530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d85b35-4f0c-473d-94bd-882bd0a34d4f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.518820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:20.524805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:20.526036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:20.527149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:20.530654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 329/663] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:20.531561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.539423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.547279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.556297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.556954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.557241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.557559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.568254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.570265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:20.584507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:20.585643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 335/664] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:20.586739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.644429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229fcfc-3f79-4506-ab91-6cd09e530a86 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.684296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.684931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.685214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.685533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.686342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:20.686648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.688156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.696311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9445d0-f0ba-4539-90fb-c58baccf97b3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.708936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 330/665] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:20.709817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.739742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.740702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.741385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.741810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.743216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:20.743683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.745427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.760148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 336/666] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:20.760989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.781869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.799156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:20.816959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f684-2209-42a6-ad7e-734695915b8d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.852508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.853130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.853485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.854062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.855008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:20.855325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.857365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.871343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 331/667] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:20.871343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.877080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86864f5b-a7a2-4fa1-8132-44b7e266d78c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:20.916784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:20.917489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:20.917777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:20.918048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:20.918804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:20.919116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:20.920624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:20.932554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 337/668] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:20.933437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:20.990987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1ab2-2915-42c1-b06e-0407c500a546 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.020899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.026517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.027232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.027588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.027937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.038449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.048305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de9ed8-cbc9-4424-ac54-eba9e69c10ac None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.083382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.084122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.084477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.084824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.091728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.093172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.101437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.103295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:21.105375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:21.106415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:21.107310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.211656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a5e45-7106-4d93-ba12-03a916c5c9d0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.215136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 332/670] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:21.216140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.246880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.247537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.247903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.248244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.251374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.260198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.261782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:21.276855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:21.277986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:21.278911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:21.278911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:21.278911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:21.278911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:21.278911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 339/671] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:21.279469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.290461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.332804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b7f8-fd5d-4671-bfb0-b32443b2a9f0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.370104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.370758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.371042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.371322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.379698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.381330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.390589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74d019-149e-4d35-9a3a-efdd0c946668 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:21.393840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:21.394730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:21.400937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.432809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.433473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.433762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.434042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.434830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:21.435142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.436579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.450138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 340/673] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:21.450967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.500604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.511723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a204-b780-4e25-9569-d37e465edd8d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.522118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.549845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.550588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.550953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.551300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.562593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.563074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96ad5-a566-40af-995d-29704f7607e9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.564045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:21.578876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:21.579752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:21.580630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:21.580630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:21.580630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:21.580630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:21.584567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 334/674] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:21.585394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.602735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.603363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.603649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.603934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.604633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:21.604941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.606349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.618161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 341/675] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:21.618965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.686631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531825b-1d80-4e41-b48a-f74e049456b9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.717829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3299cd-ed29-41d1-9266-99cb49a609a0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.720021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.720711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.721068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.721454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.722308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:21.722685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.724196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c95ba-8402-4c48-b927-92f8db19275e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.737531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 335/676] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:21.738903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c9f4-dd17-4bfc-b009-21c15b533523 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.739264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c9f4-dd17-4bfc-b009-21c15b533523 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.739608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102c9f4-dd17-4bfc-b009-21c15b533523 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.744845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 336/677] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:21.744845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102c9f4-dd17-4bfc-b009-21c15b533523 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.745057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.746275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.753180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.753792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.754200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.754525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.755349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=7e0f106ea63a4aa781ad03d7583abd89) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:21.755855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.757575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.763380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 342/678] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/role_assignments?user.id=7e0f106ea63a4aa781ad03d7583abd89&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:21.764150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.855563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102c9f4-dd17-4bfc-b009-21c15b533523 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.902154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd7d4-8953-43b5-ba49-6cce908b9d45 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:21.904516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.905166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.905490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.905770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.906484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:21.906794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.908213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.924422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 337/679] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:21.924621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:21.943944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:21.944318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.944616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.944892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.954957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:21.956403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5426b9ac-3080-4d62-89de-d30a157c0e32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:21.968778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:21.969820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:21.970728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:21.973351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 343/680] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:21.974848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:21.975106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:21.975388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:21.996310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:21.997628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:22.000245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.043230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f406816-7276-4592-834b-5cc1f8c3273a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.049009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.073115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 344/681] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:22.074351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.082875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.083706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.084000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.084388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.086366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:22.086366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.087860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.101718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 338/682] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:21 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:22.103065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.222816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5cd0-60aa-4d65-b785-fe470fd1c6c9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.261037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e81-4286-479f-b332-c63a6bd2ce54 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.272789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.273642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.274037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.274463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.282869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.285238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.294873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:22.299373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:22.300446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 345/683] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:22.301766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.315004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.315967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.316269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.316555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.317733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:22.318096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.320613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.339885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:22.340742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.353157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.424156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd6e2-964e-45f6-894a-abaee69bbfbd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.467595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.468283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.468543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.468828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.469556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.470981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad9529-ad57-4876-a497-9f7e2d04f6cf None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.471105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:22.482888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:22.484103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:22.485139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 346/685] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:22.486090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.517877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.518589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.518834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.519148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.520027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:22.520346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.521847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.539502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 340/686] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:22.540657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.592953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.627764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740b7f6-c250-414e-9c45-310f88a15589 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.631188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.655905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330976-cb3c-4c0c-bd3c-aa0461d63bf5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.671829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.672665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.673098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.673552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.696110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.696746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.697031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.697343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.698312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:22.698312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.699720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.704951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 341/687] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:22.705982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.750453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.752301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.844605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1222-3f11-45f2-9cb4-f2d2a185705c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:22.857471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 347/688] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:22.859531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.861187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:22.865451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:22.898725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:22.900250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:22.901030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:22.901569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:22.902572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=ae9a68a43b80458caf2e622129508c5c) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:22.903458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:22.906122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:22.921501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 342/689] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/role_assignments?user.id=ae9a68a43b80458caf2e622129508c5c&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:22.921501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:23.019715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22a4a-9fa0-4141-935c-9f96ab5ff9c6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:23.068319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:23.070488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:23.072034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:23.072684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:23.074929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:23.075661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:23.078267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:23.091689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:23.120926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce329502-8166-45af-b28c-933bef8e19f7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:23.163645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:23.164322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:23.164606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:23.165135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:23.182459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:23.184048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:23.200525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:23.201538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:23.202681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:23.202681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:23.202681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:23.202681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:23.202681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 343/691] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:23.207852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:23.280314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:23.316727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6af30-217d-448d-8120-ae8f654ae0d7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:23.361555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:23.362510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:23.362962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:23.363498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:23.364378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:23.364855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:23.366978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:23.389524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:23.395992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:23.447048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:23.557251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176515-f528-4bb6-9976-8e74998a996c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:23.597661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:23.598314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:23.598665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:23.598950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:23.607929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:23.609592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:23.621885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:23.622769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:23.623805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 344/693] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:23.629090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:23.773106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c2aa9-ce5e-49d1-83ed-0db165734e51 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:23.811988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:23.826597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:23.827231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:23.827513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:23.827787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:23.828545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:23.828852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:23.830317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180e32-2bae-4166-9128-0e6e3e4bf2ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:23.846534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 350/694] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:23.852767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:23.980614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:23.997260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ea78-8c14-4161-95a5-d6e59d6637fd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:24.032410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:24.032950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.033233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.033542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.034337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=d44c1c7b81af41e5a016950b3aeb8589) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:24.034649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:24.036092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f049ccc-a920-4783-aa0e-ac506c50cec1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:24.042680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 345/695] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:23 2022] GET /identity/v3/role_assignments?user.id=d44c1c7b81af41e5a016950b3aeb8589&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:24.114551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ca4d-309a-4f50-bcd3-8fa9bc2cf64d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.115088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ca4d-309a-4f50-bcd3-8fa9bc2cf64d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.115088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6ca4d-309a-4f50-bcd3-8fa9bc2cf64d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.117001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 351/696] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:24.122600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.123054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.123240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.151230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:24.152464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:24.245247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 346/697] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:24.268830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6ca4d-309a-4f50-bcd3-8fa9bc2cf64d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:24.382615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6ca4d-309a-4f50-bcd3-8fa9bc2cf64d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:24.419182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:24.420207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.420695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.421173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.433027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:24.434791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c9824ea2-d6fc-4949-b90e-d8efead7836d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:24.450677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:24.451562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:24.452472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:24.452472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:24.452472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:24.452472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:24.454693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 352/698] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:24.462381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:24.521579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae604-eafd-4d8b-8462-7984869a908e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.521892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae604-eafd-4d8b-8462-7984869a908e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.522148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae604-eafd-4d8b-8462-7984869a908e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.524123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 353/699] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:24.529303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.529722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.530009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.553201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:24.554492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:24.561151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:24.589579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b836-ceb7-413b-ac88-ebd6d78ae29c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:24.597612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:24.641071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 354/700] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:51:24.656200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:24.656847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.657129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.657431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.658140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:24.658449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:24.659837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:24.666077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:24.680149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 347/701] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:24.685907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:24.774883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a21532-768d-42bc-94e9-a75869a91ddb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:24.800724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdecb11-7efa-4081-9577-ad8e9f681333 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:24.813172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:24.813861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.814146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.814519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.826892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:24.832377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:24.833371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:24.834203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 355/702] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:24.839938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:24.851088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:24.851745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:24.852034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:24.852315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:24.853001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:24.854470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:24.871107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:24.885127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:24.903918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 348/703] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:51:24 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:51:24.966324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a34a-f274-4d77-85fd-4c4b7781e5ef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:25.004809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:25.005481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.005762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.006044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.006839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:25.007149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:25.008531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:25.018608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 356/704] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:25.025434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:25.161196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09631-ab5d-497a-bbb2-5302709330a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:25.196892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:25.197600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.197886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.198166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.209593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:25.211649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:25.226623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:25.228532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:25.229817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:25.229817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:25.229817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:25.229817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:25.229817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 349/705] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:25.233431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:25.347349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:25.358369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d4629-d315-451c-ac26-29b25890025c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:25.395576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:25.396208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.396491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.396771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.398102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:25.398409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:25.399779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4b048-21fc-40bf-a1e0-dc2127a628d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:25.413090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 357/706] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:25.419069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:25.476743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:25.533599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30506-5e07-4a05-a0da-f08f8ffd8f73 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:25.571265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:25.579769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.580062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.580346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.588799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:25.590381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:25.601926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:25.602844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:25.603771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 350/707] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:25.606260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc81e-bce9-4803-8bd1-ba357c2d9aca None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.606543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc81e-bce9-4803-8bd1-ba357c2d9aca None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.606819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc81e-bce9-4803-8bd1-ba357c2d9aca None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.608454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 358/708] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:25.613804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:25.614545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62eb9-86f8-48c7-be9a-8e7c640e691b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.614836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62eb9-86f8-48c7-be9a-8e7c640e691b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.615115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62eb9-86f8-48c7-be9a-8e7c640e691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.731348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52119a5b-9ec2-42d9-983f-57046021b932 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:25.753736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:25.766671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:25.767310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.767591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.767865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.768671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:25.769054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:25.770655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:25.817791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-52f62eb9-86f8-48c7-be9a-8e7c640e691b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:25.819480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-52f62eb9-86f8-48c7-be9a-8e7c640e691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:25.909455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 351/709] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:25.911026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 359/710] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:25.918264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:25.946614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4bc5-e220-4036-8635-be750a85cced None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.947239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4bc5-e220-4036-8635-be750a85cced None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.947768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4bc5-e220-4036-8635-be750a85cced None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.949579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 360/711] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:25.954868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:25.955434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:25.955929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:25.982107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:25.984258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:26.037608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d27d-500a-4b0b-8c77-3a816ab1b03b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.059802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 361/712] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:51:26.060998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.077640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.089929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.091080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.091593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.092150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.128862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.176861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.178349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.179320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bf36-494c-4f5a-867d-95b4e046c187 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.215963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.216969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.217488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.218004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.218904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.220529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.249760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 362/713] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:26 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:26.251476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.299011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:26.302229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.410428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.413878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.453343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8799-ffa0-4ab4-8867-d84ba394bff4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.477568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af6b-0eaa-4aef-8b06-4e565030b40b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.492947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.493165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.493411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.493619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.506905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.508453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:26.527368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:26.528439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:26.529403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:26.529403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:26.529403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:26.529403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:26.529622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 353/715] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:26.534107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.535243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.535530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.535813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.535918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] PATH_INFO: `/v3/services/network` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.536775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.538986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:26.555375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:26.556411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:26.557235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:26.560403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 363/716] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:26.567036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.652190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5ade-2957-44d0-a9cd-872d409e7678 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.672350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.694980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.695969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.696353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.697159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.698324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:26.698747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.700844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d6c4-dc85-4895-93ba-37725188175c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.717529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c134537-b6dd-42c5-97db-ff97e9992a35 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.717748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 354/717] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:26.719469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1d5-30ba-4f61-aea1-91d9e10b7df6 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.719825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1d5-30ba-4f61-aea1-91d9e10b7df6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.720963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf1d5-30ba-4f61-aea1-91d9e10b7df6 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.722512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 355/718] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:26.727928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf1d5-30ba-4f61-aea1-91d9e10b7df6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.755701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:26.763396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.764338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.764814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.765384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.766365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] RBAC: Adding query filter params (name=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:26.766890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.768754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4178c10-f578-4fd8-8b84-5d7dd07231ce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.775127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 364/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:26.776675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.777158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.777703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.797036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:26.798496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:26.852388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf1d5-30ba-4f61-aea1-91d9e10b7df6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:26.877415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 365/720] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:26.878780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.893869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:26.893869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:26.893869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:26.894084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:26.909169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:26.910667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:26.923969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:26.924854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 356/721] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:26.926373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:26.985742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.014109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ea14c-d848-43aa-8097-8f06578c7a29 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.040660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.050411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.051039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.051327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.051609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.052495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:27.052611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.054805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.056353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eabbe-6eb6-4bc2-8925-041208a94a9d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.062604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 366/722] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:27.063541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.096379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.097680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.098237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.098716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.111182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:27.117901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:27.118802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:27.119684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:27.127395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 357/723] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:27.129405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.172792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0146cd6-369b-4197-b086-e33206b55df5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.212016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.212649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.212937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.213217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.214038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:27.214352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.215785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.229056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 367/724] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:27.235028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.246561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87efef5-be3e-415d-a6a8-5866ecbc9872 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.269871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.289511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.290742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.291889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.292415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.292960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.295248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:27.296161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.301324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.320453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 358/725] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:27.327594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.362721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb034f-3839-48cf-99aa-fc6c7467eb00 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.434433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.435112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.435400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.435680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.436478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:27.436790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.438252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.446807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 368/726] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:27.500708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d3c05-7caf-4f4c-9f28-9c2c070bbce6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.556144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.556734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.557016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.557307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.581769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.583859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-035e028e-9d9f-4d94-beca-b5411ace4465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:27.603145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:27.604072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:27.604955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:27.604955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:27.604955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:27.604955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:27.604955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 359/727] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:27.610313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.752813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af574e-5ad8-43bf-bf74-1ac132642595 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:27.767601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.796975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:27.797652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.797937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.798270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.798982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:27.799290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:27.800668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:27.805605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debdb6-62a6-478c-ac7a-953ddb164fc3 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.805890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debdb6-62a6-478c-ac7a-953ddb164fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.806223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debdb6-62a6-478c-ac7a-953ddb164fc3 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.807779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 360/728] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:27.812734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:27.813022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:27.813337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:27.817877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 369/729] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:27.824448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.834415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:27.836678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:27.849561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:27.937490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 361/730] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 19:51:27.972458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:27.975941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d870-b9e3-4538-9ae9-5913b16c4a2b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.036832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.037545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.037882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.038651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.055071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.056579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:28.077119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:28.079386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:28.081710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:28.082964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 370/731] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:28.085296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.138873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.163245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ad60-44a0-4809-9087-ae81346e1c2f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.222641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf71b-983c-4b49-a6f7-7bd15ffb85b4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.258578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.259252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.259502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.259776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.269020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.269757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.270033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.270307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.271110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:28.271416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.277851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.283946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:28.289175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:28.291841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:28.293862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 362/732] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:28.301774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.305136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.315323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 371/733] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:28.324742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.418088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289300e2-99ba-44f7-932b-ab93b9dac590 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.487624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.488586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.489021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.489500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.490368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:28.492889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.494482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.519013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 363/734] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:28.523268 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.528547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.544371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9cde-dcc4-4e07-80cf-ba7fd0fcf0f7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.612276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.613412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.614499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.615087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.658352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.707063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604331d-09af-419e-bcd4-d6effbca665c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.710296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.712083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d133099-7793-4cae-a220-2355a6397a40 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.749524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.750181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.750466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.750743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.762706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.764325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4f634b49-4c4d-4cef-b074-70352a67aaa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:28.780810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:28.782035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:28.783124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:28.783124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:28.783124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:28.783124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:28.786715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 364/735] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:28.789213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c492-50e3-4af1-b1bd-5481911b0e9e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.789213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c492-50e3-4af1-b1bd-5481911b0e9e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.789434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c492-50e3-4af1-b1bd-5481911b0e9e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.791204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 365/736] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:28.791919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646c492-50e3-4af1-b1bd-5481911b0e9e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.811858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.822218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 372/737] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:28.823324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.823616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.823897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.848553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:28.849947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:28.919120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646c492-50e3-4af1-b1bd-5481911b0e9e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:28.933963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 373/738] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:28.935137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:28.940577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:28.975685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:28.976325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:28.976611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:28.976890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:28.977618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:28.977927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:28.979306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:28.992122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 366/739] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:28.992928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.076293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b08c4-cf56-4c31-84fc-3bb41cec06f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.110485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b1697-6575-45ef-82bc-4d388cbeef43 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.111470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.125759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.126878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.127366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.127892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.139080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.141064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.149293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.149987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.150274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.150555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.151198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.152672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:29.158966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:29.159835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:29.160718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:29.160718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:29.160718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:29.160718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:29.163436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 374/740] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:29.164775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:29.165441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:29.166341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:29.167780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:29.171482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 367/741] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 19:51:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:29.173315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.221245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.280796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6387-5c57-4c47-9b3f-b764e77a9a48 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.286009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e8e8-6369-4b2c-82f8-eb14c4172ad5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.318678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.320152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.320749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.321331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.323556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.324292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.324582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.324904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.325877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.326055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.327426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.331524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.333199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.340766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 368/742] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.341727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:29.347047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:29.347957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:29.348867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:29.352532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 375/743] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:29.352532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.396856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.473130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b1afc-afe4-4091-b6d3-6d4f2f2e8988 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.478943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.483206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab199a07-d353-4499-bbc4-2fdceaa19aea None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.521699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.522970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.523258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.523537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.530491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.531023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.531868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.531976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.532657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.533146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.534372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.535553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.538334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.544536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 369/744] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.545598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:29.550799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:29.551763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:29.552649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 376/745] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:29.553698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.660678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.669793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8e6d-d535-4793-a2a0-9ca909233aac None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.676619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0916f7-f0c5-4338-9f4f-91f4fc7f1f43 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.707328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.708586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.709161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.709840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.711237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.711785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.713195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.718335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 377/746] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.718335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.723138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.723138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.723138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.723138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.723402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.723402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.723402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cab14-e14f-4bae-82ee-6f328d675887 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.744226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 370/747] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.745532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aaf8d-7a70-409b-bca6-786db98dbd07 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.745820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aaf8d-7a70-409b-bca6-786db98dbd07 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.746099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aaf8d-7a70-409b-bca6-786db98dbd07 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.747567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 371/748] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:29.750044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aaf8d-7a70-409b-bca6-786db98dbd07 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.778430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.830962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b3f8-8456-4052-a84d-badd40d63b84 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.860139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aaf8d-7a70-409b-bca6-786db98dbd07 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.864141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.864759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.865043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.865349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.866164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.866983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.868416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.882201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 378/749] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.882201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:29.895745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:29.896370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.896647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.896916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.897707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] RBAC: Adding query filter params (interface=public, service_id=5d848125101d48838e3131535abdf272, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:29.898015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:29.899367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeb69-39a3-40c4-83d6-fbb87b33bb57 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:29.901462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:29.907064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 372/750] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/endpoints?service_id=5d848125101d48838e3131535abdf272&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:29.908079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05284-d939-401e-a26f-936f33219e2f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.908364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05284-d939-401e-a26f-936f33219e2f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.908639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05284-d939-401e-a26f-936f33219e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.926526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-95c05284-d939-401e-a26f-936f33219e2f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:29.927634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-95c05284-d939-401e-a26f-936f33219e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:29.982886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d438e7f-fbd4-4ceb-855f-dd43dd78afd1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:29.992102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 373/751] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:29.993366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f371e8-5351-470e-90d8-12610fda6465 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:29.993652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f371e8-5351-470e-90d8-12610fda6465 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:29.993925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f371e8-5351-470e-90d8-12610fda6465 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:29.995150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 374/752] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:29.995840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f371e8-5351-470e-90d8-12610fda6465 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.022257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.022871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.023154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.023319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.023418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.089388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.090839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885727ec-3322-4908-ba7d-f31c08557a71 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.107677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f371e8-5351-470e-90d8-12610fda6465 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.107820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.141551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.142163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.142443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.142715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.143495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=d44c1c7b81af41e5a016950b3aeb8589) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:30.143802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.145329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.150620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 375/753] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/role_assignments?user.id=d44c1c7b81af41e5a016950b3aeb8589&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:30.151383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.211043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 379/754] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:30.213601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.214091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.214704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.234977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:30.236222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:30.243689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.267244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba2e5-52aa-4115-ad82-7c999291f2a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.304024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.304663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.304944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.305226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.305987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.307374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.321695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 376/755] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/services => generated 544 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:30.322590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.324984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 380/756] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 19:51:30.326746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.385005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.447707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a6c8-3b9d-4093-b637-bc9ed117454b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.450045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a508f4-b98f-4d78-ba14-1a5dcfd7b7f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.483238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.483788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.484076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.484362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.485060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.486524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.498148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.499371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.500020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.500692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.507170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 377/757] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:30 2022] POST /identity/v3/services => generated 240 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:30.508006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.512120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.516054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.517955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:30.541186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:30.542397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:30.543321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:30.543321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:30.543321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:30.543321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:30.545317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 381/758] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:30.552014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.654205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04356-f5b0-4f36-89cd-038d2bb7818a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.720162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.720823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.721107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.721421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.732973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:30.736096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:30.739563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:30.740562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:30.741503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:30.742603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 378/759] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:30.742712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522c37-dbef-4391-b258-b8aab7e46972 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.748479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.781489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.782101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.782442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.782722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.783418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:30.783723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.785182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.798873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 382/760] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:30.804211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.831260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:30.859792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb776a50-dbb1-4b22-b3d8-98152d017a58 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.895580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.896266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.896549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.896821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.898181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:30.898488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.899875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.910059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 379/761] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:30.914911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b999a-638c-4955-82ed-53e234482249 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:30.918123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:30.950350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:30.950994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:30.951270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:30.951545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:30.962750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:30.964219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:30.986064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:30.987039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:30.987913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 383/762] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:30.993600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.022583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:31.102777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731fd4-a306-4560-9b31-6455620fe92e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.139634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.140254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.140538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.140816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.141608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:31.141982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.143476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.156833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 384/763] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:31.159344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ae5-af7d-4920-b3fe-394ca27d28f1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.163509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.214689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:31.238504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.239139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.239426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.239702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.261225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.262831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:31.290626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:31.291556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:31.292434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:31.292434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:31.292434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:31.292434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:31.304776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 380/764] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:31.305730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.320997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:31.354076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca734ea-4b4c-496e-8fb1-7598ec332ce7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.423328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.423968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.424248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.424524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.425356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=85d4f04027f54c20a5a89b029bbd21aa) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:31.425668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.427147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.433522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 385/765] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:31 2022] GET /identity/v3/role_assignments?user.id=85d4f04027f54c20a5a89b029bbd21aa&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:31.475216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d2f9-98c0-4a70-9394-882354dc19ab None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.521127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.521724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.522048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.522371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.523095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:31.523401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.524895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.546562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 381/766] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:31.552299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.672093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312cf9f-5f16-48a5-9084-7677b467dc38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.714717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.715373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.715652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.715930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.726071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.727578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:31.741839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:31.742852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:31.743767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 386/767] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:31.750634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.807271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:31.891354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5cff-9b13-4192-a80b-e980e05ba6a2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:31.943435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:31.944132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:31.944417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:31.944695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:31.945544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:31.945858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:31.947292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:31.972597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 382/768] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:31.978731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:31.986433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:32.128066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a9f21-210e-4273-ba05-2a576abbc6cf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:32.170890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:32.171540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.171822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.172098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.186792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:32.188242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:32.209455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:32.210426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:32.211911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:32.211911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:32.211911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:32.211911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:32.211911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 387/769] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:32.218330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:32.351623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:32.360431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebce40-f8f8-4acd-bf7e-342f444dc7a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:32.396130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:32.396676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.397528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.397813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.399309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:32.399617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:32.401012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e84b3-50c7-4d57-8cd5-6b4874167f31 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:32.413690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 383/770] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:32.419034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:32.513330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:32.517027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050b5c-4c08-4283-8a55-856e5bc8ec04 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.517344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050b5c-4c08-4283-8a55-856e5bc8ec04 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.517689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050b5c-4c08-4283-8a55-856e5bc8ec04 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.519471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 384/771] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:32.529102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.529417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.529698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.565634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:32.566897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:32.587037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ff77-3044-4adc-9437-9ddb5252526f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:32.632274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:32.632922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.633205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.634718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.647095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:32.648492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:32.670450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:32.671401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:32.672966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:32.673625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 388/772] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:32.680890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:32.711984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 385/773] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:32.736619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:32.883813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ffeb-3b87-4721-b199-1f83e0e5a907 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:32.904747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:32.922801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:32.941701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02919b8-5e52-440a-be3d-4d727d9af187 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:32.960582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:32.961208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:32.961519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:32.961800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:32.962566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:32.962879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:32.964322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:32.981544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 389/774] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:32.983948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.012318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.012968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.013250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.013564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.024478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-096b9529-3bd1-469c-ba5e-b56e8382cd5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:33.029381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:33.030262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:33.031085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 386/775] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:33.032220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dc42-6a44-41fd-bcc5-90cf3a5bd7e9 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.032383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dc42-6a44-41fd-bcc5-90cf3a5bd7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.035815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23dc42-6a44-41fd-bcc5-90cf3a5bd7e9 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.035815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 387/776] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:33.039839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23dc42-6a44-41fd-bcc5-90cf3a5bd7e9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.099564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e516-9331-4975-8632-ecb8e169101a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.136587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.138003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.138488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.139330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.142683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=be490d99a6d94f5ead55b8d35019ec9e, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.144270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dc767-5646-4c3e-bfec-3a5517337a96 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.144919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23dc42-6a44-41fd-bcc5-90cf3a5bd7e9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.161552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 390/777] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:32 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:33.163527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595a7f-966d-420c-9e4b-1515db1c026c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.163812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595a7f-966d-420c-9e4b-1515db1c026c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.164089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595a7f-966d-420c-9e4b-1515db1c026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.195223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d3595a7f-966d-420c-9e4b-1515db1c026c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:33.197291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d3595a7f-966d-420c-9e4b-1515db1c026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:33.205690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.206971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.207641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.208289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.210346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:33.211036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.213616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f85c-75f6-4f6c-9563-5baece44c9a4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.230800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 388/778] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:33.233415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7077115-b7eb-462e-aa60-ac1193eef98d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.234196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7077115-b7eb-462e-aa60-ac1193eef98d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.234975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7077115-b7eb-462e-aa60-ac1193eef98d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.238006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 389/779] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:33.239874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7077115-b7eb-462e-aa60-ac1193eef98d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.246354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.262476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.338121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 391/780] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:33.339779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.340211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.340632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.362870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:33.364277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:33.398877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7077115-b7eb-462e-aa60-ac1193eef98d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.441705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.442402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.442684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.442960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.453425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 392/781] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:33.454299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.460019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.463869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:33.486623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:33.487533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:33.488702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:33.488702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:33.488702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:33.488702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:33.488702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:33.489514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.557641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.570393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.578027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f4427-b1e0-4b89-b22f-426e8b0d21a4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.615167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.615840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.616122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.616399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] PATH_INFO: `/v3/services/network` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.617030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.617795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53439c20-e0ce-46c1-a382-a1ee6b30b3cc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.618502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:33.635025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:33.636204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:33.637234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:33.640122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 393/783] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:33.641070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.665450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.666692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.667131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.667582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.668389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.670414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:33.683188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:33.684332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 19:51:33.685363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:33.688842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 391/784] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:33.694594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.761082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba1db8-4184-4630-ab44-098b0f4a6d9c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.797851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.798383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.798666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.798979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.799677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:33.800117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.801450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.814528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 394/785] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:33.815775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.824321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b4439-bc5c-4815-9f2d-e64b921a72ce None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.839064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.847018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:33.864584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.865378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.866213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.866502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.867190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] RBAC: Adding query filter params (name=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:33.867499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.869004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.877728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 392/786] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:33.877728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.936283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1280625-c8c7-4875-b0c2-1a3d19cb38e6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:33.972556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:33.973102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.973430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.973713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.974394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:33.974698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:33.976099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401a5b-1218-4b30-8bcb-0b1aad4814d1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:33.980659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 395/787] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:33.981842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795794b-b8c7-4acc-9d24-688b5dfc9632 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:33.982126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795794b-b8c7-4acc-9d24-688b5dfc9632 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:33.982402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795794b-b8c7-4acc-9d24-688b5dfc9632 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:33.983766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 396/788] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:33.988269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795794b-b8c7-4acc-9d24-688b5dfc9632 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:33.992725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05c280-cb86-48e0-9d74-7a6c0ba2c7db None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.029048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.030052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.030508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.030943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.038977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.041124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:34.053906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:34.055023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:34.056283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:34.058230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 393/789] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:34.059179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.079830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.097598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795794b-b8c7-4acc-9d24-688b5dfc9632 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.113069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.134564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.135269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.135473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.135738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.136416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.136726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.138157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f92dc-c3df-427d-995c-c5665a26edb7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.147859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 397/790] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.147859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.147859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.147859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.165178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:34.166391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:34.174790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b8982-b13a-40a8-a1be-106b39508a22 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.210818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.211445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.211737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.212011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.212697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.213008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.214416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.220315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 394/791] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.221101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.249372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 398/792] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:34.249372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.330460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888f6b3-8ad2-447d-9f80-b7708af6f6e6 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.338180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.344027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.362819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaa08c-fd8a-4764-b9d9-7f95daafc81f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.371807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.372742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.373188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.373650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.374677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.374992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.376549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.400145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 395/793] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.400145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.400837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.400837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.400837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.400837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.401421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] RBAC: Adding query filter params (interface=public, service_id=d287096c18d84c0baf9829fe36b9b3fd, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.401626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.402994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.411125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 399/794] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/endpoints?service_id=d287096c18d84c0baf9829fe36b9b3fd&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.411914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.505298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612c2f-2914-4ef1-88fe-9ba28d840d7f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.514648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320940-0886-4f7d-916e-7fa14a889410 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.541477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.542096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.542379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.542658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.543370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.544735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.554089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.554729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.555015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.555295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.566169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 396/795] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:34.566979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.578738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:34.585117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:34.586360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:34.587421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:34.590123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 400/796] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:34.591260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.597305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.611919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.711602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177c0e1-15b1-469f-bb87-ffe3dd8c20e8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.732018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e0bb-8527-40d0-89e2-eea3969678c1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.752196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.753136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.753502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.753792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.766130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.768497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.781105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.781907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.782458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.782751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.783420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.784791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:34.788706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:34.789906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:34.790762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:34.790762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:34.790762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:34.790762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:34.790762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 397/797] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:34.791051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 401/798] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.791462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.798034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.877571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.897770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:34.917584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d4a8-0d0d-49f9-86bb-972e1a1b28b2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.927652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65edcb-36a8-4b0c-8eda-9fd733cb1610 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:34.955828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.956601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.956840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.957114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.957874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.958183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.959603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.965125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:34.965809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:34.966096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:34.966379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:34.967092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:34.967404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:34.968877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:34.969481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 398/799] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:34.976157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:34.997350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 402/800] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:35.010384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.091090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a7462-00c4-4247-8b6e-e034b0e93fef None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.140215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.147254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.148019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.148302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.148573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.163959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.170185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda0a0-67e9-4e1e-b185-28e4f2349f27 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.174935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:35.198156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:35.199103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:35.199976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:35.199976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:35.199976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:35.199976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:35.210396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.210734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 399/801] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:35.212508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.226328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.227317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.227824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.228303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.253294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.256341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:35.281557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:35.282488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:35.283353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 403/802] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:35.294250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.406781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da397-6d26-403d-b905-69c78a69c770 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.432686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a8a4-adbc-4fc7-8869-6f95c5343b60 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.460402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.461039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.461338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.461620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.466283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:35.466606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.468003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53382c82-ec7c-4f74-baa5-29ac912972d6 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.486812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 400/803] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:35.488455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fba5-d16c-4f0d-8651-f5bb7275540b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.488971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fba5-d16c-4f0d-8651-f5bb7275540b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.489967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509fba5-d16c-4f0d-8651-f5bb7275540b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.492539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 401/804] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:35.493896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509fba5-d16c-4f0d-8651-f5bb7275540b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.498017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.498986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.499517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.500012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.500987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:35.501528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.503256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140548a-c687-4702-8faa-047d836f1587 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.523376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 404/805] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:35.530735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.533812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.533812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.588538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.592510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:35.594150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:35.660364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509fba5-d16c-4f0d-8651-f5bb7275540b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.664909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.701966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 405/806] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:35.703221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.710102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.710773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.711057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.711332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.724057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.726116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:35.748444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:35.749474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:35.750386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 402/807] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:35.750983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.829377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29acb8-80b9-4003-8b00-b94b1cac346f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.868567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.869242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.869567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.869845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/d44c1c7b81af41e5a016950b3aeb8589/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.871896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=d44c1c7b81af41e5a016950b3aeb8589, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:35.873502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:35.879596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092527a-ae71-4d2b-9195-8dbd80510779 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:35.891322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.893419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 406/808] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:35 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/d44c1c7b81af41e5a016950b3aeb8589/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:35.894243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:35.944799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:35.950177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:35.951229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:35.951713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:35.952186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:35.966822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:35.975793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:35.976738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:35.977594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:35.980565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 403/809] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:35.986988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.118638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df5d4-0eaf-4db8-8334-d476b8512ed4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.136397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5295f-68c6-4394-a804-ab5de8af5070 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.168592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.169978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.170744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.171674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.172905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:36.173482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.175917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.180515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.181294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.181690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.182063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.183354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:36.183862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.185457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.190076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 404/810] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:36.196100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.215969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 407/811] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:36.221663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.242700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:36.349743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb8c3-0194-4b69-9db1-4b458ff8fb81 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.369779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:36.377315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5485-082f-46f0-b5e7-9580ae381c3f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.408828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.409512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.409797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.410072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.432700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.434206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.434850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.435042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.435420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.435788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.451757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.453301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:36.459112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:36.460287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:36.461470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:36.461470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:36.461470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:36.461470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:36.462907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:36.467538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:36.471524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:36.473318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:36.475982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:36.475982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:36.475982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:36.475982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:36.475982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 408/813] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:36.482459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.609814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de34c0-8963-4869-a099-6a83cd335200 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.651934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.652564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.652847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.653122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.653868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:36.654174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.655382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:36.657288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.673528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 409/814] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:36.678367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.688329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:36.706285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01db74-c4f8-4617-83ea-f00d4c79ffdb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.796589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc47b28-df25-445c-8755-1294a4e5418d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:36.804862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.805542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.805880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.806164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.806880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:36.807190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.808581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.837223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:36.837940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:36.838224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:36.838501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:36.839608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 406/815] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:36.845599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.850812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:36.853589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:36.872346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:36.874762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:36.877980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 410/816] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:36.879371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:36.985894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.034478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a56e-c258-4824-ab1f-bc14995320c5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.051761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30da3-c689-4fea-b6be-2d1604428796 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.072971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.073632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.073917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.074195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.074950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:37.075366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.076903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.089754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 411/817] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:37.097489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.121735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.122395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.122676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.122953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.134681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.136139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.148747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:37.163033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:37.164008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:51:37.165183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.166408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 407/818] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:51:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:37.174269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.241397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff9bd8-fa40-4b2c-9468-345b7768b13e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.266014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.276372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.277043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.277485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.277785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/85d4f04027f54c20a5a89b029bbd21aa/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.285205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267b10a-7e79-4990-a05d-f914f9c4f0d9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.293327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=85d4f04027f54c20a5a89b029bbd21aa, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.294784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56c154-3cfb-4783-ae3d-be1e0f3e23a8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.308767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 412/819] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:37 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/85d4f04027f54c20a5a89b029bbd21aa/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e239-82d5-4c7f-84ed-84fcc1e50110 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e239-82d5-4c7f-84ed-84fcc1e50110 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e239-82d5-4c7f-84ed-84fcc1e50110 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 413/820] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b13-6d90-4205-974e-4fee3c748ef0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.313639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b13-6d90-4205-974e-4fee3c748ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.314036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b13-6d90-4205-974e-4fee3c748ef0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.318096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 414/821] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:37.318096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.318096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.318096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.331812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.332458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.332791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.333073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.333930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:37.334306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.336303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280a37-ab9a-4c0b-865d-88935405ff8e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.339404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:37.340664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:37.361166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 408/822] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:37.362636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.362928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.363208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.383584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:37.384802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:37.419302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 415/823] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:37.420247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.479834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.502643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 409/824] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:37.503925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.543431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9e14-ab0a-40e5-bf53-a25bfb10824c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.551906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.581173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.581982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.582342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.582690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.615968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afed81-acfc-4534-bbfa-549da33361d3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.653866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.654946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.655444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.655905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] PATH_INFO: `/v3/services/network` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.656740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.657121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.658671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.659052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:37.670192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:37.671198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 19:51:37.672006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.674282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 410/825] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:37.675384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.746435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.783173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 416/826] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:37.784332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.797032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:37.806475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff15d0-a93a-4240-9e5c-e2f804d758ff None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.843572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.844328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.844675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.845023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.845763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.847863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:37.865826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:37.866835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:37.867639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:37.869436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 411/827] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:37.870358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:37.934462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb4e96-a700-4c72-9875-2302acd8f9f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:37.982637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:37.984639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:37.985651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:37.986416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:37.987320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] RBAC: Adding query filter params (name=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:37.988091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:37.990568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.002125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 417/828] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:38.002675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.013497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2cc83-521c-495a-a492-57e703cc6ee2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.028315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.051817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.052431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.052725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.053697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.073487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.075651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.096648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:38.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:38.101786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:38.102638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:38.102638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:38.102638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:38.102638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:38.110293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 412/829] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:38.110784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.138416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52291c-5c6d-464b-b856-5051e5faca02 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.177082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.177754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.178598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.178881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.179551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:38.179930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.181369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.191626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 418/830] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:38.191626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.247825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1d973-dfc5-4555-8c5b-26b5b3b92182 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.294372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.295350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.295864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.296596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.297967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:38.298753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.301765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.308116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4ccf5-a2e8-4f59-829f-a0b3f4b6e107 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.318245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 413/831] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:38.319483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.357249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.358090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.359574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.360152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.360895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.361862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:38.362380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.366216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.368058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.387438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 419/832] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:38.387438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.459103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2f784-e5fb-409c-86f8-4ee3be2ec2b3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.497038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.497713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.497978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.498312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.498998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:38.499301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.500815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.504506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef395a-3eff-42f3-929a-5245531daad6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.506893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 414/833] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:38.507867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.551986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.552627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.553481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.553758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.554504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.556034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df939-ad86-478b-a935-02c818dcf129 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.589621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 420/834] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:38.589621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd380-22dc-4466-b15d-6665ae259a44 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.589621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd380-22dc-4466-b15d-6665ae259a44 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.589621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bd380-22dc-4466-b15d-6665ae259a44 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.589621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 421/835] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:38.592986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.593796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.594291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.639036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:38.641670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:38.679733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.692183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219dd72-e7e2-4f51-bc9f-1de8fe0732ff None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.722359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:38.747119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.748325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.748746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.749027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.752991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 422/836] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:38.760199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.761741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:38.774477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:38.775423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:38.776314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 415/837] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:38.779255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.783193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.910852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0544-dfb6-46cb-aed2-4646d0386499 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.915142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6ac6-0ea3-4851-b116-f0e12ef0d4c3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:38.960773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.962712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:38.962712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.962712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.962712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.963153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:38.963416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:38.964221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:38.964705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:38.964873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:38.965418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:38.980972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:38.981158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 416/838] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:38.986730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:38.988838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:38.989781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:51:38.990651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:38.993303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 423/839] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:39.002283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.004350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.059309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.108806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe046e0-d83c-4e45-a92c-6461b1c30040 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.144023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928aea-f12f-48ce-afe2-924f39a60967 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.153372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.154338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.155286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.155793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.157573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:39.158100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.160518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.170508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 417/840] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:38 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:39.194620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.195260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.195540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.195814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.196538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:39.196845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.198325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.208484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 424/841] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:39.218382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.307426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.336187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5f9c-fd07-4777-84ab-99c153faf1b5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.372593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.373244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.373558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.373833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.385739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.387206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a009fbbe-a049-4cdb-a5e2-0505650a658b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:39.402557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:39.403434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:39.404304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:39.404304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:39.404304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:39.404304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:39.404304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 418/842] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:39.411089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.474163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63227-e3a4-4f60-b1af-2aae9d562c35 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.475425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63227-e3a4-4f60-b1af-2aae9d562c35 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.475927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba63227-e3a4-4f60-b1af-2aae9d562c35 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.477663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 419/843] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:39.482831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.483225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.483604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.503694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:39.505676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:39.515685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea8325-711f-43d0-b71e-dd2095554bf3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.517623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.556048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.557153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.557484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.557769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.558477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:39.558791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.560864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.574354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 425/844] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:39.580144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.587767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 420/845] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:39.613164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.677205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.704163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28113d-ab1f-483e-8620-95847cad6eeb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.724716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab53977-ede0-4cd4-976b-0d449f92bcce None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.739176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.739890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.740184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.741011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.748741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.750270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.760855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.761545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.761830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.762107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:39.763106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:39.763993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:39.764900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 426/846] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:39.774616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.775021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:39.780383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:39.781286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:39.782131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 421/847] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:39.794307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.806388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.908389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16eac2-a5d0-4855-8ee9-3ec429047432 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.927962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120768a1-7bae-4a8f-92e4-b013961eb318 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:39.945147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.945819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.946103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.946381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.947182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:39.947495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.948176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:39.950109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.968634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:39.969637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:39.970121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:39.970594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:39.976155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 427/848] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:39.976302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:39.976302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:39.976302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:39.977666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:39.986748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 422/849] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:39.993216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.062242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.083130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d9ca-17b8-456a-affb-822b960279eb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.098629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ac3b0-8ec0-45fe-b3ab-8c5070c587fd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.118764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.119223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.119508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.119787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.137409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.138296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.138778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.139282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.150623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.152339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:40.168000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:40.168886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:40.169804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:40.169804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:40.169804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:40.169804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:40.171672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 423/850] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:40.177174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.201203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.203509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.215917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.307077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.308637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a407712-3ff6-411e-b7ec-f064f1f43b71 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.330283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 428/851] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 19:51:40.335987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.351668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.352327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.352617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.352894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.353638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:40.353944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.355417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.369886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 424/852] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:40.375176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.446889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e97c94-5f2c-4ce1-bac5-9746805eea90 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.485634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.486679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.486982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.487241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.494326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.499099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.500882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.507279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc12b0-c9a3-4246-b49d-f999c3f848ef None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:40.516237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:40.517123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:40.518044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:40.518044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:40.518044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:40.518044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:40.522072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 429/853] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:40.523710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.551557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.552472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.552584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.553374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.559834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.560636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.562301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:40.575948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:40.576897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:40.577864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 425/854] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:40.586412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.639457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd054d4-c743-4cde-a5aa-8682f03c68f6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.683737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.684700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.685169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.685656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.687074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:40.687572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.690072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.705427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 430/855] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:40.713708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.721466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f36ad-9170-4519-880b-1123b1ea9d77 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.758564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.759205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.759446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.759727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.761146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:40.761146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.762387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.785160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 426/856] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:40.786321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.797742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.835517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:40.846414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d449-b2ac-4cc0-947f-8b3122eeeb8c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.890473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.891056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.891439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.891793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.898857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:40.900405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:40.903257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae1c0-8f75-45f3-ab8e-bc6eea1abb25 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b037b8a1-78db-47df-9f5d-8f4b97e2900c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:40.911999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:40.913706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 431/857] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93852df0-4638-4c89-8aea-f428fb0ecbda None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.919982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93852df0-4638-4c89-8aea-f428fb0ecbda None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.920569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93852df0-4638-4c89-8aea-f428fb0ecbda None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:40.920569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 432/858] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:40.920569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93852df0-4638-4c89-8aea-f428fb0ecbda None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:40.947399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:40.948030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:40.948317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:40.948595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.022617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.023981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.025812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93852df0-4638-4c89-8aea-f428fb0ecbda None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.033733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.061195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.061844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.062129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.062410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.063163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:41.063476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.064908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0677139-ec30-412e-be20-57742aafd5de None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.077216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 433/859] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:41.078441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.078732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.079015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.096605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:41.097878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:41.105734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.136653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 427/860] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:41.137534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.170976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 434/861] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:41.171824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.248236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b393-049a-4c28-9609-8383429a0df7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.259074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.285559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.286103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.286379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.286648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.287475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=d44c1c7b81af41e5a016950b3aeb8589) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:41.288101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.289205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.295582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 428/862] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/role_assignments?user.id=d44c1c7b81af41e5a016950b3aeb8589&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:41.296506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.301248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cac3cb-7d1c-4712-9189-dbff6be36137 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.340675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.341374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.341664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.341945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.353316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.354852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.356918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-538732f6-3d5b-4dee-b39a-ed3df9f53935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:41.372286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:41.373239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:41.374143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:41.374143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:41.374143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:41.374143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:41.374143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 435/863] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:41.374880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bced-bb4d-448c-b6d9-a7e654558a5f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.375174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bced-bb4d-448c-b6d9-a7e654558a5f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.375459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bced-bb4d-448c-b6d9-a7e654558a5f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.377122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 436/864] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:41.379082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bced-bb4d-448c-b6d9-a7e654558a5f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.419467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eef64-5127-4b41-bcac-6c6f602e123b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.459998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.460877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.461153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.461458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.462159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.463521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201e5f3-f1db-4576-adc2-ec2f55ee33fe None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.482369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 429/865] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:41 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:41.483680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ba16-b925-48b8-8139-372042890611 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.483965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ba16-b925-48b8-8139-372042890611 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.484334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ba16-b925-48b8-8139-372042890611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.507098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2119ba16-b925-48b8-8139-372042890611 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:41.508331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2119ba16-b925-48b8-8139-372042890611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:41.509512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bced-bb4d-448c-b6d9-a7e654558a5f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.542892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.568117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.568830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.569123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.569444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.570472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:41.570794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.573149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.592586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 437/866] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:41.598285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.600221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 430/867] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:41.622312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119ba16-b925-48b8-8139-372042890611 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.659885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.724188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b163a6c-772c-4c67-aef4-1bfac0870230 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.755930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119ba16-b925-48b8-8139-372042890611 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.767276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.767938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.768230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.768510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.777479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.779360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.793832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:41.794605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:41.795495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:41.796393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 438/868] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:41.797577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.798111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.798578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.799433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.801393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.801625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:41.812864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:41.813873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:41.814685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:41.819145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 431/869] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:41.825067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:41.854437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.936208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cd365-5ed8-498c-aef8-bc144f2b11f5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.947089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:41.956504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e06c-f3f7-49a7-9fa0-b2e46addc878 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:41.977826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.978721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.979171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.979593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:41.981036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:41.981788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:41.984103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:41.998220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:41.998849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:41.999191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:41.999471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:42.004840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:42.004840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:42.004840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:42.005574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 439/870] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:42.006367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:42.011691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 432/871] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:42.016908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:42.121529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70b4c-4f94-499b-b91f-a06810509ee4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:42.138908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:42.151154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730444-22da-46cd-8275-0dae6de79009 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:42.164706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:42.165361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:42.165649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:42.166088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:42.166882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=85d4f04027f54c20a5a89b029bbd21aa) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:42.167560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:42.169332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6edbe-c220-4de7-bdc8-67b261b6b619 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:42.176967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 440/872] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:42 2022] GET /identity/v3/role_assignments?user.id=85d4f04027f54c20a5a89b029bbd21aa&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:42.194629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:42.195697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:42.196160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:42.196711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:42.197658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:42.198119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:42.199834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48031443-6ead-4f0d-82d2-65c7e1f7c603 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:42.207891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 433/873] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:43.387924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4710-eb4e-4ee6-b1d9-1171f1d5ba56 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.388452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4710-eb4e-4ee6-b1d9-1171f1d5ba56 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.388527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4710-eb4e-4ee6-b1d9-1171f1d5ba56 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.390508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 441/874] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:43.396373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689754-6b18-4a3c-b8fe-e5925ed88b4f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.396841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689754-6b18-4a3c-b8fe-e5925ed88b4f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.396918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64689754-6b18-4a3c-b8fe-e5925ed88b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.415985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-64689754-6b18-4a3c-b8fe-e5925ed88b4f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:43.417171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-64689754-6b18-4a3c-b8fe-e5925ed88b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:43.493642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 434/875] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:43.510274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb4710-eb4e-4ee6-b1d9-1171f1d5ba56 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:43.549744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:43.620632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb4710-eb4e-4ee6-b1d9-1171f1d5ba56 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:43.643297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b4f1-8ec7-4d86-8b79-9ddb15666772 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.643868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b4f1-8ec7-4d86-8b79-9ddb15666772 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.644343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43b4f1-8ec7-4d86-8b79-9ddb15666772 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.646211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 435/876] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:43.651239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.651746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.652219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.655687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:43.656438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.656723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.657015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.657757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:43.659215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:43.668724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:43.669709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:43.670552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 442/877] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:43.676393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:43.678971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:43.680367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:43.765515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 436/878] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:43.784381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:43.786549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:43.794048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c4cc5-45a8-46bc-ad93-903120eae9de None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:43.804114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:43.843906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:43.844735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.845116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.845560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.846347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:43.846758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:43.848842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:43.857318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 443/879] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:43.863093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:43.911795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db084f1-a51a-4ff6-99db-e18e1757fe18 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:43.960339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:43.961504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:43.961938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:43.962800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:43.963553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:43.965575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:43.978634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:43.979712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:43.980523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:43.985350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 437/880] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:43.986997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:43.989914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029bab3-9a3f-4b4a-9c35-f6bed087850e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.034365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.034990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.035271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.035544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.036217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:44.036520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.038566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.043937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 444/881] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:44.090601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.115812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798fde7-e13e-4c29-aa2a-0bc14e6e8e6a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.153646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.154541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.154972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.155395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.156275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:44.156742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.158407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f47b1-4f71-4046-8e58-11a9f369af03 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.164967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 438/882] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:44.171024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.203341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.282131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0d6f-3f5a-46c7-ab0f-14e7d6c8a9c4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.297311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94dae-04f8-4609-a341-75a136b776e2 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.297625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94dae-04f8-4609-a341-75a136b776e2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.297888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94dae-04f8-4609-a341-75a136b776e2 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.299510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 439/883] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:44.304585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb5e3-5e3f-4ed9-849e-1d7d8ba77076 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.304877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb5e3-5e3f-4ed9-849e-1d7d8ba77076 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.305159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb5e3-5e3f-4ed9-849e-1d7d8ba77076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.324828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.325485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.325773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.326049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.326744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:44.327056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.328430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f57c06-698b-4119-9290-275f5d49d11d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.328528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ad2bb5e3-5e3f-4ed9-849e-1d7d8ba77076 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:44.329716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ad2bb5e3-5e3f-4ed9-849e-1d7d8ba77076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:44.335383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 445/884] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:44.340228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286ded2-05eb-4daa-9e21-4e5c76db2faf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.340228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286ded2-05eb-4daa-9e21-4e5c76db2faf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.340228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286ded2-05eb-4daa-9e21-4e5c76db2faf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.340817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 446/885] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:44.342137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286ded2-05eb-4daa-9e21-4e5c76db2faf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.422043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 440/886] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:44.423311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.430378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.430378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.446601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:44.447791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:44.448161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.462356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286ded2-05eb-4daa-9e21-4e5c76db2faf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.497669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.498348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.498578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.498857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.499615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] RBAC: Adding query filter params (interface=public, service_id=37a369a30e124287a6dd4616229cb0e6, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:44.499931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.501311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.507584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 447/887] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/endpoints?service_id=37a369a30e124287a6dd4616229cb0e6&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:44.508601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.523318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 441/888] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:44.524317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.526775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.634154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba621a-53b8-4ea5-936e-bf962006c5b5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.645960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb9d81-4505-4f41-812f-87159f0f12a3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.669138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.669799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.670088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.670368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.671051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.672486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.685292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 442/889] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/services => generated 1011 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:51:44.685292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.696789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.697614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.698304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.698470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.713766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:44.721591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:44.723621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:44.724981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:44.729295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 448/890] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:44.729295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:44.748197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.769119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:44.821518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899f80-46ca-4ea1-a22c-2101287d685d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.868241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.868882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.869166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.869493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.870207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.871586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.872490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081a73-1da2-40bc-8797-466c323d654b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:44.895010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 443/891] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:44 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:44.922740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:44.923286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:44.923571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:44.923852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:44.924639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:44.924967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:44.926464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:44.941436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 449/892] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:44.943080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:45.063004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06b68b-1f31-45a9-8e76-9fe4bcbfc6a9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:45.091605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:45.105067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:45.105966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:45.106255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:45.106535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:45.119521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:45.120995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:45.138194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:45.139110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:45.139953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:45.139953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:45.139953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:45.139953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:45.139953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 444/893] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:45.145068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:45.222244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:45.257524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a732-0811-4219-b554-a1ec98050bb6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:45.293215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:45.294354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:45.294880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:45.295358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:45.296248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:45.296758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:45.298365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:45.314400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 450/894] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:45.319851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:45.429699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78963927-8af6-402d-8749-fb7101a9b0bb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:45.469709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:45.470747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:45.471230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:45.471704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:45.480600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:45.482316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:45.494875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:45.495783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:45.496706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:45.499214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 445/895] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:45.506482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:45.611961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad599b-9772-4ab7-a8b0-45e2736e9c69 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:45.642184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:45.649138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:45.653993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:45.654419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:45.654825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:45.655781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:45.656239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:45.657844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:45.676511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 451/896] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:45.682666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:45.726835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:45.794656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865451e-d7e8-44aa-919e-abdcabfddcae None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:45.833043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:45.834199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:45.834692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:45.835190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:45.910219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:45.911941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ac0bb-3b08-4113-ad20-f96578f32603 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:45.953679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:46.025247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 446/897] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:45 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:46.026909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.133038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82a16-cfc7-4903-a1bc-f3c07187e41c None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.133393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82a16-cfc7-4903-a1bc-f3c07187e41c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.133640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82a16-cfc7-4903-a1bc-f3c07187e41c None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.135134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 447/898] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:46.140033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.140380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.140665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.143599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82294db7-992b-42de-a88b-ab022864e810 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.160391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:46.161738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:46.182250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.182919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.183202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.183479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.195848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.197253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:46.213564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:46.214458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:46.215310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:46.215310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:46.215310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:46.215310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:46.215310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 452/899] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:46.221057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.245651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 448/900] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:46.267543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.274058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:46.341383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:46.348908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d79a-8b5e-4092-9d29-5dd996a4b112 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.379890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766cab5-15bb-4902-ba0b-1ef80681b2d3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.394538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.395629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.396063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.397382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.398724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:46.399186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.401226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.418006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 453/901] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:46.425399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.425399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.425399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.425399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.425818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.425914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.426003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.444147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 449/902] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:46 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:51:46.557466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355748b0-4ec7-4795-91cb-8c0fe3458210 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.559127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:46.602850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.603551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.603835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.604115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.611222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.612668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:46.624762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:46.625642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:46.626503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 454/903] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:46.632439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.746928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7f5a-729f-498e-98e9-b037ebe5e294 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.779509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:46.783375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.784359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.784826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.785303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.786374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:46.787435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.789689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd85f5-7e7c-4230-9f3b-d9b9ab294544 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.803252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 450/904] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:46.810415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.822896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3862-17eb-4625-a307-571bd8ba5b3d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.823186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3862-17eb-4625-a307-571bd8ba5b3d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.823471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3862-17eb-4625-a307-571bd8ba5b3d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.825110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 451/905] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:46.830443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.830732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.831013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.849538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:46.850746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:46.937452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 452/906] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:46.939552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03239052-9b66-4558-b433-e5bf73a81d15 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:46.953664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:46.975966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:46.976877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:46.977366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:46.977822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:46.978813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] RBAC: Adding query filter params (role.id=2ea9da2bb11a496f836f9737227242a3, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=85d4f04027f54c20a5a89b029bbd21aa) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:46.979302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:46.980897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:46.986957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 455/907] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/role_assignments?user.id=85d4f04027f54c20a5a89b029bbd21aa&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=2ea9da2bb11a496f836f9737227242a3 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:47.067005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f73bf7-7a78-4455-9c22-9b3b235d9da0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.087466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.106802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.107466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.107754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.108032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.108676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.110200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-fb8508fd-08fc-4a95-9081-71d7ad2dc04e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:47.120703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:47.121771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.122568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 453/908] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:47.128474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.149657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33129-ef59-471d-a87f-a4fab2788a49 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.150229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33129-ef59-471d-a87f-a4fab2788a49 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.150592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33129-ef59-471d-a87f-a4fab2788a49 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.154477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 454/909] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:47.157473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.157753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.158025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.163190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.185843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:47.187048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:47.252932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da128d-7044-4405-9d1c-7365b1cd38b8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.277316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 455/910] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:47.299906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.301478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.302123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.303053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.303335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.304140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:47.304454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.306001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.316522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 456/911] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:47.317608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.413759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646295f-5a35-4800-954e-03cfeb78b2d6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.416285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.429369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.435364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457814-5fb6-4c99-96e1-e7a11d1e5e1b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.453485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.454814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.455316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.455787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.456633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.458283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:47.469230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:47.470176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:47.470994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:47.472456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.472857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.473145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.473457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.474139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:47.474481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.479664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.480135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 456/912] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:47.481166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.481317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 457/913] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:47.486723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.588618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122d122-ba1f-4871-ba55-8a5a4148752f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.595289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbda00-adb4-49f6-8885-0849eef03340 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.624778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351420-ec9b-435d-be36-fb521546694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.625844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351420-ec9b-435d-be36-fb521546694e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.626325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351420-ec9b-435d-be36-fb521546694e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.626795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11351420-ec9b-435d-be36-fb521546694e None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.627670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11351420-ec9b-435d-be36-fb521546694e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:47.628185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11351420-ec9b-435d-be36-fb521546694e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.629779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11351420-ec9b-435d-be36-fb521546694e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.632317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.633090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.633424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.633710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.634428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.635794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.641600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 457/914] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:47.643708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351420-ec9b-435d-be36-fb521546694e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.660666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 458/915] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:47.708329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.781392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11351420-ec9b-435d-be36-fb521546694e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.824986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.825988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.826466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.826936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.827832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:47.828329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.829910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:47.835979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 458/916] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:47.842438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:47.857436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:47.957538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d4582-64b5-4b39-868d-f73894b37312 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:47.993157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:47.993816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:47.994105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:47.994389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:47.995152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] RBAC: Adding query filter params (interface=public, service_id=1581472e62a14b80bf0b5445fb122a00, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:47.995471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:47.996852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46578d9d-9372-4b16-876f-785129ebf4e3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:48.002585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 459/917] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:47 2022] GET /identity/v3/endpoints?service_id=1581472e62a14b80bf0b5445fb122a00&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:48.008175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:48.115807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:48.119066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584395-457e-4e54-aa4e-d72bc9960e3a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:48.157051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:48.158086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:48.158568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:48.159223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:48.160150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:48.161773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1420-4e3e-4edb-8ac1-a33613cdddd5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:48.169403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 459/918] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:48 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:51:48.622652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c0a1-2e50-4c65-b3f7-3a500e08174e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:48.623168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c0a1-2e50-4c65-b3f7-3a500e08174e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:48.623244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9c0a1-2e50-4c65-b3f7-3a500e08174e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:48.624854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 460/919] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:48.630141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:48.630586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:48.630754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:48.649451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:48.650653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:48.724975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 460/920] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:48.745111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9c0a1-2e50-4c65-b3f7-3a500e08174e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:48.821581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:48.858631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9c0a1-2e50-4c65-b3f7-3a500e08174e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:48.893162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:48.893819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:48.894116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:48.894406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:48.895050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:48.897134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-395bc14c-2bad-4061-882e-5b7be0e65570 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:48.906667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:48.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:48.908462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 461/921] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:48.914893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.014478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.023464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a3c8-b4e7-426c-bd18-efbb162c057a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.044966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1960-8201-492d-a97a-8af38eb813be None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.045302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1960-8201-492d-a97a-8af38eb813be None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.046138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1960-8201-492d-a97a-8af38eb813be None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.047626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 462/922] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:49.053920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.054263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.054550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.065368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.066005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.066292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.066572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.067265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:49.067577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.069526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.075509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 461/923] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:49.077961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:49.079378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:49.080833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.177386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 463/924] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:49.196482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.199416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddda50-2be8-4363-98bc-0afbf1354443 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.235587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.236216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.236503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.236781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.237499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:49.237811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.239183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.249955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 462/925] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:49.250948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.272795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.279123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.327465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03df32d-3c2f-403b-b21e-59dc24538265 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.369001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8765b-f8b8-48d8-9d62-9c39551f6e71 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.379712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.380909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.381282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.381644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.392683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:49.398363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:49.399249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:49.400098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 464/926] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:49.406664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.421826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.422455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.422792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.423072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.423883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] RBAC: Adding query filter params (interface=public, service_id=1d37f440da0147c0bd8a2dc05491e8f1, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:49.424201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.425595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.436238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 463/927] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/endpoints?service_id=1d37f440da0147c0bd8a2dc05491e8f1&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:49.437828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.532849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46582-26f3-4f9d-a978-3ebec507985e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.539783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.556738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517c04-dd28-437a-bb50-bf0223fc2315 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.562058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.574975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.575785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.576209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.576622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.577593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:49.578133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.579689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.594348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 465/928] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:49.595712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.599026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.600153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.600438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.600718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.602058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.602792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.613671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 464/929] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:51:49.711452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71747-e3fd-4d50-82d8-c8ff904c39c4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.748599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.749280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.749624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.749906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.762453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.763958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7ce058bc-bd40-483e-b8c0-56e4986f0191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:49.780633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:49.781593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:49.782461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:49.782461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:49.782461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:49.782461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:49.782461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 466/930] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:49.790127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.899058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebef8a3-7554-476c-b62a-f633e569f8ff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.899344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebef8a3-7554-476c-b62a-f633e569f8ff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.899620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebef8a3-7554-476c-b62a-f633e569f8ff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.901258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 467/931] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:49.906032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.906319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.906598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.908117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffb7c-2489-4828-a0e4-8b5237e24908 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:49.924872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:49.926142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:49.951282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:49.952948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:49.953480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:49.954218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:49.955549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:49.956350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:49.958509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:49.960583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:49.977458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 465/932] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:49.982416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:49.998260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.009299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 468/933] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:50.030204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.101733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740aad-4711-4ebf-9650-63500b4e094b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.138917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.139866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.140380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.140859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.149289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.151011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.154497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e913f2e-998d-4beb-9207-891a3243835a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:50.163960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:50.165149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:50.166123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:50.168674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 466/934] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:50.173995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.196741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.197880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.198314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.198740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.199587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.201738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.204785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING keystone.server.flask.common [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 19:51:50.226988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.sql.core [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 19:51:50.226988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 19:51:50.226988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [parameters: {'id': 'a2ceba13fc0a4caa9ab0c42fdb9307a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 19:51:50.226988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2ceba13fc0a4caa9ab0c42fdb9307a6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2ceba13fc0a4caa9ab0c42fdb9307a6. Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:50.237249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 19:51:50.238095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application yield resource Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise self.value Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application session.commit() Jul 28 19:51:50.239038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.flush() Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application compat.raise_( Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 19:51:50.239951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 19:51:50.240813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:50.241781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [parameters: {'id': 'a2ceba13fc0a4caa9ab0c42fdb9307a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.242755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:50.243514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a2ceba13fc0a4caa9ab0c42fdb9307a6. Jul 28 19:51:50.244843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.252020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 469/935] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 19:51:50 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:50.253426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.268449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.283649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.307654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95db73-05a1-46de-a213-a6acd661bb36 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.344946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.345910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.346339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.346761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.347720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:50.348236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.350440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764705d-0a33-4005-8cf9-13537d572f13 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.360528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8b539-16a4-4c3f-a60a-b1e49171d4c5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.369786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 467/936] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:50.371257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec2eb-4f4c-4110-a489-510e0b7def0a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.371538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec2eb-4f4c-4110-a489-510e0b7def0a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.371813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec2eb-4f4c-4110-a489-510e0b7def0a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.373232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 468/937] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:50.378004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ec2eb-4f4c-4110-a489-510e0b7def0a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.401221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf276-2475-4dac-937a-78215e38233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.401892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf276-2475-4dac-937a-78215e38233a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.402178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf276-2475-4dac-937a-78215e38233a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.402462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf276-2475-4dac-937a-78215e38233a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.409205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf276-2475-4dac-937a-78215e38233a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.410875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf276-2475-4dac-937a-78215e38233a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-370bf276-2475-4dac-937a-78215e38233a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:50.423130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:50.424209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:50.425066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 470/938] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:50.425620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.425908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.426187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.444313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:50.445885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:50.493498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ec2eb-4f4c-4110-a489-510e0b7def0a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.513983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 471/939] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:50.514890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.524983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.536392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.537925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.538414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.538865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.541636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.553542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.555456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:50.571627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:50.572659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:50.573735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:50.573735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:50.573735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:50.573735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:50.575498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 469/940] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:50.576410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.636459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e8b5-90e9-404d-858d-e71c5295a242 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.672681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.673331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.673623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.673905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.674674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:50.674986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.676412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.681681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33cd16-28cc-4311-b3f5-1e59b2cdde2f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.696499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 472/941] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:50.697167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.737435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.739348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.739820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.740240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.741030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.742658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:50.757443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:50.758629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 19:51:50.759695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:50.762393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 470/942] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:50.768741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.792291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.826489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:50.827256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7382a3-65f7-47a9-85ba-9d9da20abcc5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.891866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.892510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.892792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.893064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.893978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:50.894155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.895494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.899035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b729-8fe0-4058-8951-65d65c2718d1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:50.907983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 473/943] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:50.913876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:50.955307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:50.956358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:50.956649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:50.956949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:50.957679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:50.957993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:50.959548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:50.965479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 471/944] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:50.971960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:51.060197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78190-9bf6-4d3f-b01d-2f12495809d6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:51.084079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91ffd-802a-4a14-8598-624f06697fa3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:51.093705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:51.108988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:51.110324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.111037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.111471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.114325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:51.122861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:51.124671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:51.125072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:51.125767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.126057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.126336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.127020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:51.127337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:51.128785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:51.139256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 472/945] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:51.140576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:51.140988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:51.142044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:51.143059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:51.150351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 474/946] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:51.151180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:51.272440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c26b-1c4b-423f-9532-391c27ceaa1f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:51.281100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba164e-2d65-4807-952d-ebcf96dea4f2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:51.310400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:51.310900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.311188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.311468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.312183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:51.313583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:51.320229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:51.321394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.321885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.322351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.323536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:51.324778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:51.326533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e09dd-bba1-4008-b818-df99ffd5dbca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:51.338684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 473/947] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:51.347829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 475/948] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:51.355033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:51.394082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:51.489151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8738-22bd-405b-9c5c-3dd34e3a165c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:51.526851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:51.527898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.528317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.528769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/85d4f04027f54c20a5a89b029bbd21aa/roles/2ea9da2bb11a496f836f9737227242a3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.531182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=85d4f04027f54c20a5a89b029bbd21aa, role_id=2ea9da2bb11a496f836f9737227242a3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:51.532930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7f1f4-3238-48b4-b2db-923a45342145 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:51.550454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 474/949] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:51:51 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/85d4f04027f54c20a5a89b029bbd21aa/roles/2ea9da2bb11a496f836f9737227242a3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:51:51.786255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cde05-25b1-457d-b197-d5345ed70924 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.786820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cde05-25b1-457d-b197-d5345ed70924 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.787217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cde05-25b1-457d-b197-d5345ed70924 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.789257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 476/950] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:51.794161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:51.794453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:51.794737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:51.813666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:51.814854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:51.888672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 475/951] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:51.911870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cde05-25b1-457d-b197-d5345ed70924 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:51.974139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:52.021491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cde05-25b1-457d-b197-d5345ed70924 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:52.058460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:52.059032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.059318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.059597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.060230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:52.061715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:52.071838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:52.072893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:52.073793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 477/952] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:52.079414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:52.095456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:52.187868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb298ea-0e7a-4e1d-b7a2-b4879cb90f06 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:52.224739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:52.232110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:52.233745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 476/953] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:52.239516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:52.343377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f5fa0-2d5e-4344-958e-056554e50c6f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:52.361207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:52.378412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:52.379039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.379323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.379599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.380846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:52.381158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:52.382632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a26a5-76c6-4bd2-bc25-e61734e01e7d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:52.388170 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 478/954] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:52.394001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:52.479538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:52.503575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66378c76-6191-457c-9bbc-5ef59aca44a0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:52.540733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:52.541804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.542311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.542813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.543734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:52.545783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c8d4c-2467-4efc-ab90-77cbbb639855 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:52.572280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 477/955] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:52.833117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3662b5-83d3-4203-ba8c-1a44b85fe593 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.833545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3662b5-83d3-4203-ba8c-1a44b85fe593 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.833731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3662b5-83d3-4203-ba8c-1a44b85fe593 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.835275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 479/956] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:52.840597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:52.840894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:52.841177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:52.860211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:52.861441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:52.938333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 478/957] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:52.963867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3662b5-83d3-4203-ba8c-1a44b85fe593 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.070480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3662b5-83d3-4203-ba8c-1a44b85fe593 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:53.106590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:53.107213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.107513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.107771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.108450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:53.109931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:53.125586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.sql.core [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 19:51:53.125586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 19:51:53.125586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [parameters: {'user_id': '51c73d952f224909b12f7675319e88b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 19:51:53.125586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:53.133818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:53.134729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application yield resource Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise self.value Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application session.commit() Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 19:51:53.135747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.flush() Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application compat.raise_( Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 19:51:53.136665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 19:51:53.138801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 19:51:53.140814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [parameters: {'user_id': '51c73d952f224909b12f7675319e88b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:53.147644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 19:51:53.149640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:53.151823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 480/958] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 19:51:52 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:53.155486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.218024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:53.265151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da927d5e-ef5b-442c-b5d0-a4aaa59a9fb6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:53.300800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:53.301480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.301761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.302551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.309894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:53.311418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4618df0e-2998-428d-a7f6-87286d41aa73 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:53.323633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:53.324618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:53.325626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 479/959] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:51:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:53.332788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.382980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:53.444994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b968d74-ce67-48cf-834e-ad0eaaa6303e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:53.480797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:53.481782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.482282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.482863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.483920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:53.484450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:53.486325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be8c5-4ac9-4b12-ab03-170f0b4e0cab None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:53.526031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 481/960] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 19:51:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:53.557757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c920b-8985-4dd1-89e0-6502b67e2a62 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.558114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c920b-8985-4dd1-89e0-6502b67e2a62 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.558317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c920b-8985-4dd1-89e0-6502b67e2a62 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.560218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 480/961] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:53.566790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28aefa-7ae7-4fd8-96bb-3d4fb6ca70f9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.567133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28aefa-7ae7-4fd8-96bb-3d4fb6ca70f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.567362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28aefa-7ae7-4fd8-96bb-3d4fb6ca70f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.589085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-eb28aefa-7ae7-4fd8-96bb-3d4fb6ca70f9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:53.590742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb28aefa-7ae7-4fd8-96bb-3d4fb6ca70f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:53.675208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 482/962] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:53.698190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c920b-8985-4dd1-89e0-6502b67e2a62 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.772038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992003e-146a-443d-b946-983d72de21fc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.772383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992003e-146a-443d-b946-983d72de21fc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.772632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992003e-146a-443d-b946-983d72de21fc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.774342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 483/963] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:53.779557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0a35-a877-4031-b235-ae467140d185 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.779852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0a35-a877-4031-b235-ae467140d185 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.780133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a0a35-a877-4031-b235-ae467140d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.805676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-923a0a35-a877-4031-b235-ae467140d185 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:53.807193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-923a0a35-a877-4031-b235-ae467140d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:53.824576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c920b-8985-4dd1-89e0-6502b67e2a62 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:53.834138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:53.845567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:53.862947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:53.863666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:53.863960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:53.864238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:53.865572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:53.867082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:53.876160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:53.881504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:53.882384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 481/964] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:53.884721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.892810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 484/965] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:53.912303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0a35-a877-4031-b235-ae467140d185 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:53.995307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dace97-a4e8-4998-a7e3-c1bdb5ba79a4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.026567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a0a35-a877-4031-b235-ae467140d185 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.031500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.032116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.032395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.032665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.033390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:54.033745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.035108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.041035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 482/966] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:54.046575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.069043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.069724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.070008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.070285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.081839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:51:54.087722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:54.088653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:54.089713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 485/967] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:51:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:54.094866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.096862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.122314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.149936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064bc8f-5e83-42d7-a240-f65c4ec80b4b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.184043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.184671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.184961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.185238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.185953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:54.186262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.187634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.192250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 483/968] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:54.204716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8446b-9bf1-436a-836e-d68d6bd06728 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.247105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.247678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.247977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.248240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.248996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:54.249337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.250774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.265145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 486/969] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:54.266069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.377450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63062680-9b9d-4d9e-81d2-21889f45948c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.391278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.414797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.415446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.415726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.415996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.427322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.428677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:54.443630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:54.444544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:54.445472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:54.445472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:54.445472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:54.445472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:54.445472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 484/970] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:54.451931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.539578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.558375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201577f-e9bc-43ac-b156-bda7a50dac0a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.591147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.591771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.592052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.592327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.593014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:54.593343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.594698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77403875-c066-4567-8e96-d8ddc43178ed None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.611471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 487/971] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:54.612629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.634046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d826-1d49-4bf8-a4d8-e70a54acebfb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.634339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d826-1d49-4bf8-a4d8-e70a54acebfb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.634617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d826-1d49-4bf8-a4d8-e70a54acebfb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.636217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 488/972] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:54.641047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.641373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.641658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.660237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:54.661933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:54.720353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947289d8-281c-4196-8ead-3f4137dae104 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.732732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 489/973] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:54.754339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.754987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.755316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.755595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.755703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.764530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.766012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:51:54.777799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:54.778694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 19:51:54.779633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:54.783693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 485/974] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:54.784509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.810880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.836330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:54.867182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8901f48-f198-4abc-94bc-4735bc4ee7a2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.894902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec66bb-c47e-49a4-b1c7-bb8fce40b8f5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:54.907993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.908810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.909493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.909781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.910693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.912556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:54.924565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:54.925558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:54.926907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 490/975] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:54.930966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:54.931597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:54.931880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:54.932161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:54.932973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:54.933147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:54.933296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:54.934740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:54.960182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 486/976] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:54.961240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.035289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a7052-6950-4fbc-a804-170b1a2ed8ac None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.047113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.067560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc04699-e4e1-41b1-b005-032acc917605 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.071758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.072379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.072662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.072941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.073644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:55.073952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.075318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.084811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 491/977] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:55.085837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.088327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.108646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.109298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.109585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.109862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.180848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.182329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.188393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73af355-4c42-4398-8fe5-189c9e58b623 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.224381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.225006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.225314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.225598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.226274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:55.226585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.228000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.237852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 492/978] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:55.238841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.268888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.290323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 487/979] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:51:54 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 19:51:55.295820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.317787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.356191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7ddef-92da-4af1-a491-7d22a84c8afe None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.391469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.392101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.392382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.392675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.393526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] RBAC: Adding query filter params (interface=admin, service_id=1d37f440da0147c0bd8a2dc05491e8f1, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:55.393841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.395188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.400492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 493/980] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/endpoints?service_id=1d37f440da0147c0bd8a2dc05491e8f1&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:55.401475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238b99b-451d-4e98-8c78-8589337f82cd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.405916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.446384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.447023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.447300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.447568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.461589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.463292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:51:55.480978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:55.481925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:55.487788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:51:55.487788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:51:55.487788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:51:55.487788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:55.487788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 488/981] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:55.488072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.509626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793a7e9-0784-403b-9ea3-855cc0ca6333 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.525778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.542398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.549626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.550336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.550647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.550924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.551571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.552953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.559281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 494/982] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:51:55.609630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7605-e928-4a67-ba78-a4682e4ebc18 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.648025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.648696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.649037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.649351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.650060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:55.650377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.651829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.669625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 489/983] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:55.671626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.784154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b81d2-8980-4709-94ff-984f019de767 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.820602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.821235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.821547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.821826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:55.828552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:55.830112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:51:55.842187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:55.843160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:55.849435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 495/984] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:55.851581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:55.954533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:55.962796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92209991-4b1f-4acf-84f0-42ebe7030944 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:55.998121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:55.998753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:55.999039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:55.999318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:56.000075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:56.000387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:56.001857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd40b-40f3-4672-be76-bdd5304f7ebc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:56.013731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 490/985] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:56.019619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:56.078080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:56.125106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b89e-7f05-469f-a623-3d60c549621a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:56.158641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:56.159183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:56.159470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:56.159752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:56.160550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] RBAC: Adding query filter params (role.id=2ea9da2bb11a496f836f9737227242a3, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=85d4f04027f54c20a5a89b029bbd21aa) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:56.160868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:56.162875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71a88-7c1f-4194-861a-0287897bb8c9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:56.177666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 496/986] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:51:56 2022] GET /identity/v3/role_assignments?user.id=85d4f04027f54c20a5a89b029bbd21aa&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=2ea9da2bb11a496f836f9737227242a3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:56.219973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a00ac-453b-4d9f-b2d8-b2b6c07938bc None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:56.220506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a00ac-453b-4d9f-b2d8-b2b6c07938bc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:56.220506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a00ac-453b-4d9f-b2d8-b2b6c07938bc None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:56.222203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 491/987] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:56.228288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776dcd1-4448-4a23-9477-c973a7118376 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:56.228583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776dcd1-4448-4a23-9477-c973a7118376 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:56.228852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776dcd1-4448-4a23-9477-c973a7118376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:56.247677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d776dcd1-4448-4a23-9477-c973a7118376 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:56.248904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d776dcd1-4448-4a23-9477-c973a7118376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:56.324363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 497/988] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:56.346842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a00ac-453b-4d9f-b2d8-b2b6c07938bc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:56.449996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a00ac-453b-4d9f-b2d8-b2b6c07938bc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:56.483033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:56.483659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:56.483943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:56.484216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:56.484915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:56.486313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3e90d-3e8f-4fa6-9f96-e959ee077cc3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:56.503042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 492/989] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:51:56 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:51:57.577602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465098fd-5aa1-46cc-bf7c-f3438585c17c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:57.578134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465098fd-5aa1-46cc-bf7c-f3438585c17c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:57.578239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465098fd-5aa1-46cc-bf7c-f3438585c17c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:57.579530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 498/990] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:57.585485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:57.585872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:57.586053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:57.604160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:57.605413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:57.616521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:57.685149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 493/991] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:51:57.706988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465098fd-5aa1-46cc-bf7c-f3438585c17c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:57.757937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:57.811268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465098fd-5aa1-46cc-bf7c-f3438585c17c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:57.847694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:57.848342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:57.848654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:57.849488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:57.850120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:57.851483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:57.865731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:57.866712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 19:51:57.867549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:57.868890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 499/992] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 19:51:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:51:57.872858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:57.975968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915b67-3cce-45ac-bbca-d2c700451449 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.009597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.010220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.010505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.010782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.011464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:58.011772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.013132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.023166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 494/993] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:58.024347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.124678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b034e-72b4-4da9-89c7-5e75c31b9624 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.138058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.160514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.161165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.161480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.161761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.162487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:58.162798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.164438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4fe79-928e-4606-aca0-740cd5a1d034 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.174243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 500/994] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:58.175472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.179358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.216135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb901-3c1f-4c01-aeca-4ef321e56ec8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.216480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb901-3c1f-4c01-aeca-4ef321e56ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.216701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb901-3c1f-4c01-aeca-4ef321e56ec8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.218212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 501/995] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:51:58.223052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.223335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.223677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.241207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:58.242356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:58.283649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d31ca-e0e9-4489-9b58-2a3632a78e46 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.314435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 502/996] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:58.322250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.322880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.323199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.323510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.324225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.325633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec9b5a-0336-4776-bd5d-df19a82f5438 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.337364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.349476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 495/997] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:51:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:51:58.447808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a94ffc-5035-4229-a3af-9b0d53746f79 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.456714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.493122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.493823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.494107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.494435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] PATH_INFO: `/v3/services/image` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.495014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.496377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:58.507429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:58.508433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:51:58.509298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 503/998] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:58.512534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981a80-9071-4f23-b648-5e4b6d2d5831 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.512821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981a80-9071-4f23-b648-5e4b6d2d5831 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.513096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981a80-9071-4f23-b648-5e4b6d2d5831 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.514411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.514529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 496/999] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:51:58.519534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.519822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.520089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.539410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:51:58.540708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:51:58.610596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.621763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 497/1000] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:51:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:51:58.635509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af212-71ff-47f1-86dc-56ecffcf7588 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.644185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.671887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.672516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.672802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.673079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.673803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] RBAC: Adding query filter params (name=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:58.674116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.675472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.686312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 504/1001] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:58.687177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.718647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.755720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be808285-6dd2-4988-a813-8c519d3843a0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.792527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.793231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.793546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.793824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.794256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39de52-2143-4d3c-9bed-6329c53f5b93 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.794455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.795853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:51:58.805929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:51:58.807248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:51:58.808062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 498/1002] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:51:58.812950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:58.838195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.838993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.839277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.839554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.840238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:58.840544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.841934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.846549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 505/1003] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:58.894069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:58.942218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ac75-c76c-43fd-a926-6b11b6b94db2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:58.977923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:58.978450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:58.978730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:58.979002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:58.979688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:58.979994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:58.981403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:58.992207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 499/1004] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:58.994027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:59.093116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:59.101803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ef22e-d5b9-4b56-bd64-697d90d1189d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:59.135132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:59.135751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:59.136032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:59.136306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:59.136975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] RBAC: Adding query filter params (type=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:59.137320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:59.138657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:59.148297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 506/1005] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:51:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:51:59.149960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:59.254467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23c0-d9bd-4538-b392-23bb4afb349c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:59.277172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:59.292067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:59.292785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:59.293213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:59.293582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:59.294410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] RBAC: Adding query filter params (interface=public, service_id=686b39017c8e43d3be8e6c5bf2969d02, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:51:59.294793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:59.296227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8903070-c6eb-4290-b93a-7e22915e24e9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:59.301457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 500/1006] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:51:59 2022] GET /identity/v3/endpoints?service_id=686b39017c8e43d3be8e6c5bf2969d02&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:51:59.307391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:51:59.408541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034c06c-c508-4d34-a758-000ecaef5def None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:51:59.443989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:51:59.444622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:51:59.444911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:51:59.445190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:51:59.445881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:51:59.447248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2b1f8-a273-4ba1-bf7d-c04553d7505a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:51:59.461310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 507/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:51:59 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:52:00.402170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394301-034c-486b-ada1-5e7a7e2148fe None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.402690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394301-034c-486b-ada1-5e7a7e2148fe None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.402690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394301-034c-486b-ada1-5e7a7e2148fe None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.404200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 501/1008] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:00.410659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.411563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.411736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.430437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:00.431619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:00.448783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:00.501961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 508/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:00.524033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394301-034c-486b-ada1-5e7a7e2148fe None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:00.632744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394301-034c-486b-ada1-5e7a7e2148fe None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:00.667302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:00.667871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.668155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.668432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.669602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:00.671042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ee565-ece7-4249-9434-3f335e39a84f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:00.677478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 502/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:00.679601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:00.783478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caff054-587c-468e-85f6-ac6a205dfb24 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:00.818176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:00.818797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.819082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.819359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.820040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:00.821546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24f99c-2e65-44da-881d-175d597b7a89 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:00.850186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 509/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:52:00 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:52:00.891879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645ad3-4c96-4276-a66b-b5b835ba1753 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.892194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645ad3-4c96-4276-a66b-b5b835ba1753 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.892448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645ad3-4c96-4276-a66b-b5b835ba1753 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.894030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 503/1012] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:00.900206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2818-755f-4836-8099-f784a263ac6f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:00.900515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2818-755f-4836-8099-f784a263ac6f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:00.900778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d2818-755f-4836-8099-f784a263ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:00.908421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:00.922199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-673d2818-755f-4836-8099-f784a263ac6f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:00.923704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-673d2818-755f-4836-8099-f784a263ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:01.003072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 510/1013] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:01.026672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645ad3-4c96-4276-a66b-b5b835ba1753 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:01.104116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:01.151894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645ad3-4c96-4276-a66b-b5b835ba1753 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:01.186846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:01.187394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:01.187673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:01.187949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:01.188635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:01.190027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053d16-bc90-44d0-a8d6-b3e1fc13fe5e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:01.213458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 504/1014] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:52:01 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:01.490568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd224d83-ecf1-4d47-b9d7-fc75773744d9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:01.491075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd224d83-ecf1-4d47-b9d7-fc75773744d9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:01.491075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd224d83-ecf1-4d47-b9d7-fc75773744d9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:01.492592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 511/1015] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:01.497689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:01.498084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:01.498248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:01.516894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:01.518114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:01.593221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 505/1016] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:01 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:01.616259 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd224d83-ecf1-4d47-b9d7-fc75773744d9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:01.719346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd224d83-ecf1-4d47-b9d7-fc75773744d9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:01.753239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:01.753856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:01.754141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:01.754418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:01.755600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:01.756973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:01.758744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:01.767187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:01.768182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 19:52:01.769009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:01.773107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 512/1017] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:52:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:01.774471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:01.816148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:01.880125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a15ee-9c67-4974-82f6-26f5cad232ab None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:01.916941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:01.917613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:01.917900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:01.918178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:01.918860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:01.919172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:01.920537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:01.930553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 506/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:52:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:01.932060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:02.035704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a725e30-6dfe-40ca-88b6-5c748e72821a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:02.070639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:02.071255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:02.071540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:02.071816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:02.072488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:02.072794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:02.074181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c56c-5473-4ce4-882e-2803a7104a55 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:02.079073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 513/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 19:52:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:02.085527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:02.184912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e608a-2b24-4b3f-8784-61d6c73e0d34 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:02.187331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:02.220324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:02.220960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:02.221233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:02.221535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:02.222251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:02.225211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535ed82-5880-4dd2-8ab4-d53dcab222aa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:02.249334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 507/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:52:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:02.929087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ff2b-bf94-448b-98cb-558daf588d66 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:02.929619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ff2b-bf94-448b-98cb-558daf588d66 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:02.929728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ff2b-bf94-448b-98cb-558daf588d66 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:02.931082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 514/1021] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:02.936166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:02.936551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:02.936744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:02.955634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:02.956819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:03.032322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 508/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:03.061377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ff2b-bf94-448b-98cb-558daf588d66 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.131575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:03.173037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ff2b-bf94-448b-98cb-558daf588d66 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:03.205661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:03.206306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.206591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.206869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.208542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:03.210001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb62f9-d627-4a75-b747-b30e4803eb69 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:03.213421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 515/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:03.217484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.242676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f465-6b91-4d8f-9bd4-d73b1fbddca7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.243253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f465-6b91-4d8f-9bd4-d73b1fbddca7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.243253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5f465-6b91-4d8f-9bd4-d73b1fbddca7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.244683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 516/1024] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:52:03.249412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.249698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.249976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.267508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:03.268691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:03.307235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:03.327688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d65e-bb94-48d7-b184-a323cde601e7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:03.344523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 517/1025] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:52:03.366861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:03.367485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.367766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.367935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.368032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.368706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:03.370368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:03.405479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 509/1026] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:52:03 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:52:03.440100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:03.492011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f518f7-4624-45df-8e7d-267b429b64a3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:03.533575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:03.534294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.534578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.534849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] PATH_INFO: `/v3/services/image` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.535484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:03.536908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:03.547469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:03.548491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:03.549844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:03.553355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 518/1027] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 19:52:03 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:03.555297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.661675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dd530-de0e-44f6-96cc-d0dae2180194 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:03.696319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:03.696870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.697153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.697458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.698141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] RBAC: Adding query filter params (name=image) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:03.698445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:03.699809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:03.709334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 510/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:03.711506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.811710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ede90-c374-4428-85f0-bc1fc19b703c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:03.835493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:03.847312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:03.847935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:03.848219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:03.848558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:03.849237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:03.849576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:03.850951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:03.858587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 519/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:03.861924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:03.871961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:03.971027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac698e7-bdd2-4b71-887e-c61e61459685 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:04.005115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:04.005776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.006061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.006336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.007094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] RBAC: Adding query filter params (interface=public, service_id=c1cda9deec4b40c4910b81dfca375e58, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:04.007406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:04.008773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdae03-badc-45e7-8554-1e4cbf38c408 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:04.017597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 511/1030] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:52:03 2022] GET /identity/v3/endpoints?service_id=c1cda9deec4b40c4910b81dfca375e58&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:04.019583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:04.119906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c2aa-7fa1-4713-a597-e33fd7bba3bb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:04.153670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:04.154295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.154576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.154849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.155498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:04.156849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf98a24-ebdf-4472-bec0-142c06c55e79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:04.164297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 520/1031] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:52:04 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:52:04.370564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c34f1-0a42-49ea-bae7-5a00c24ef6ea None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.370894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c34f1-0a42-49ea-bae7-5a00c24ef6ea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.371135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c34f1-0a42-49ea-bae7-5a00c24ef6ea None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.372522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 512/1032] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:04.377664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.377963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.378248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.397383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:04.398560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:04.451145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:04.472349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 521/1033] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:04.495357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c34f1-0a42-49ea-bae7-5a00c24ef6ea None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:04.567902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:04.602354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c34f1-0a42-49ea-bae7-5a00c24ef6ea None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:04.639307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:04.639880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.640164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.640440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.650873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:04.655784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:04.656700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:04.657631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:04.661612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 513/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:52:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:04.663010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:04.762949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0e843-0f81-49da-a158-d800538fb762 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:04.796718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:04.797411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.797670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.797951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.798669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:04.798981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:04.800344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:04.809153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 522/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:52:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:04.814681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:04.924460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222145e7-c8ce-4f78-bfc4-619aab082d41 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:04.954445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:04.961084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:04.961763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:04.962049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:04.962329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:04.972656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:04.974666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:04.990024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:04.990873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:04.996477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:04.996477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:04.996477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:04.996477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:04.996477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 514/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:04.998131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.045734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.102056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1cc1c-8346-4048-9668-be68d67a624f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.136102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.136727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.137007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.137307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.138009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:05.138324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.139692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.156461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 523/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:05.157868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.262070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72fdc-a96f-4f55-86a3-fd6fff1659c7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.298968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.299618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.299902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.300179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.307860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.309399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:52:05.320725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:05.321900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:05.322844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:05.323874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 515/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:05.327682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.429426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05548-565f-4feb-a1ef-14758b9dba4c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.431738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.464484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.465100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.465405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.465678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.466458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:05.466761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.468165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333b4c-e353-4033-ba51-b0c5907a3744 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.490562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 524/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:05.491718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.499302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccba97-6438-46e6-a00b-6c8305fd9b70 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.499597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccba97-6438-46e6-a00b-6c8305fd9b70 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.499880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccba97-6438-46e6-a00b-6c8305fd9b70 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.501234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 525/1040] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:52:05.506432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.506726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.507007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.526424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:05.527557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:05.537932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.598806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90525d4-fd78-41b5-bb66-31b5e3e4bce1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.603921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 526/1041] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:52:05.626434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.634298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.634926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.635213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.635493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.704927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.706420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.724241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.734814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7faa8-11a4-4269-a563-adf551211f71 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.749551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.770694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.771343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.771622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.771893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.782292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:05.787283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:05.788248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:05.789802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 527/1042] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:05.794770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.827129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 516/1043] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 19:52:05.828180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.918451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e63196-a3a1-45c7-a6de-edb9953d457b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.938898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366e88-62b3-4b27-83ac-14c9d9d62ace None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:05.961664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.962290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.962581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.962863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.963582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:05.963895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.965286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.974298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 528/1044] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:05.975847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:05.976500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:05.976784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:05.977061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:05.980053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:05.987932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:05.989924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:05.991697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:05.997320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:06.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:06.007759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:06.008756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:06.008756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:06.008756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:06.008756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:06.010306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 517/1045] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:06.015759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.087354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3e80-5ed4-4b73-823f-8d6c148f02f3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.126430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.127086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.127372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.127554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd95656-c0b3-48b8-8efc-541afe8d462a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.127657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] PATH_INFO: `/v3/users/8153d4c2424742d7b2ba1dfe93a4835e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.144083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] RBAC: Authorizing `identity:get_user(user_id=8153d4c2424742d7b2ba1dfe93a4835e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.146379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.153062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 529/1046] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:05 2022] GET /identity/v3/users/8153d4c2424742d7b2ba1dfe93a4835e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:06.154703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.163079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.163968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.164261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.164540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.165242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:06.165590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.166963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.186718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 518/1047] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:06.191890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.232397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.247458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.261256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a58d-6c75-4490-b043-78df78434281 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.292254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0a79-e67d-4d1d-bac6-68914d5d7f20 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.295467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.296091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.296374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.296651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.326698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.327335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.327620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.327896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.335227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.337196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-3682d057-9987-4eb6-8d2a-3f3c812bfa21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:52:06.348638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:06.349598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:06.350485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 519/1048] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:06.351030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd24a-e2f3-46b2-8e0f-26546652936d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.351340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd24a-e2f3-46b2-8e0f-26546652936d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.351590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd24a-e2f3-46b2-8e0f-26546652936d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.353121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 520/1049] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:06.355411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd24a-e2f3-46b2-8e0f-26546652936d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.370810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.372260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3a200-727a-4a87-8665-24cc4ba4c285 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.439153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.455511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd24a-e2f3-46b2-8e0f-26546652936d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.469681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.475938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 530/1050] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:06.475938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.475938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.475938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.490140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:06.490353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.490968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.491248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.491345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:06.491526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.492269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:06.492577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.494025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.505949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 521/1051] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:06.510172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.559268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 531/1052] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:06.560357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.610804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27e9c-c655-456a-b37a-8e21b833efc9 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.644059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.644695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.644975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.645305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.646457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.647891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.649661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 522/1053] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:06.650447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.665667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26a423-9a67-480e-a9bd-d35a26c664f0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.667198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.694003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.701076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.701805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.702091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.702371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.703163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] RBAC: Adding query filter params (role.id=2ea9da2bb11a496f836f9737227242a3, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:06.703482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.704922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.710766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 532/1054] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=2ea9da2bb11a496f836f9737227242a3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:06.711542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.768552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584864-b184-4f66-ad8d-db0fd13d6d04 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.808449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.809131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.809452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.810065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.810724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.812139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:06.821925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:06.822997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:06.824481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 523/1055] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:06.829442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:06.836314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865552f-76ba-425e-96b7-eb3063b41a03 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.876517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.877547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.877839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.878115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.878916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=5320535831aa4a4e88f49faeb61a7307, user.id=8153d4c2424742d7b2ba1dfe93a4835e) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:06.885666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:06.887745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:06.895903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 533/1056] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/role_assignments?user.id=8153d4c2424742d7b2ba1dfe93a4835e&scope.project.id=5320535831aa4a4e88f49faeb61a7307&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:06.958213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a65f3-b13a-4e52-b1ad-2ce484698df1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:06.967290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:06.998131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:06.998768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:06.999024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:06.999300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:06.999994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:07.000303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:07.001937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:07.007950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 524/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:07.013580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:07.049934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:07.121907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1a02a-f7d8-49c9-b2de-c17414877dcb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:07.158201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:07.158747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:07.159030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:07.159302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:07.159970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:07.160275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:07.161708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa2c4-b94b-49c2-bb67-65dfd666c572 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:07.167122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 534/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:07.173159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:07.276947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbfc7-9545-4a34-8938-66b42337ebf3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:07.310246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:07.310880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:07.311166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:07.311451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:07.312179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:07.313576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed04d08-2efd-47a9-ae48-1a7bcaec766a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:07.341016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 525/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:52:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:08.689925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ff50-3ee3-4e23-b581-fbb0ba42204f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:08.690448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ff50-3ee3-4e23-b581-fbb0ba42204f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:08.690448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ff50-3ee3-4e23-b581-fbb0ba42204f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:08.692465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 535/1060] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:08.697714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5a1b-7b22-4660-85d9-4f8b95259e5c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:08.698144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5a1b-7b22-4660-85d9-4f8b95259e5c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:08.698312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d5a1b-7b22-4660-85d9-4f8b95259e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:08.716923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ef7d5a1b-7b22-4660-85d9-4f8b95259e5c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:08.718138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef7d5a1b-7b22-4660-85d9-4f8b95259e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:08.739317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:08.795548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 526/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:08.818311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ff50-3ee3-4e23-b581-fbb0ba42204f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:08.899937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467e1-d2fb-435e-8809-a00ad288e19a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:08.900219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467e1-d2fb-435e-8809-a00ad288e19a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:08.900492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5467e1-d2fb-435e-8809-a00ad288e19a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:08.902006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 527/1062] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:52:08.911234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:08.911684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:08.911972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:08.927315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:08.932655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:08.933889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:08.934903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ff50-3ee3-4e23-b581-fbb0ba42204f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:08.973098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:08.974185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:08.974464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:08.974736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:08.986471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:08.991345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:08.992247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:08.993939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 536/1063] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:52:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:08.998887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.017475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 528/1064] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:52:09.029914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.105078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76723-4cf7-41c5-97ad-1ee7262e4695 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.110932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.130618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c5ba8-23fe-4d38-adc6-d102d4c3714b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.142121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.142933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.143367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.143876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.144859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:09.145866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.147492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.156989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 537/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:52:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:09.162616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.169770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.170419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.170699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.170973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.180952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.182139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:09.187581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:09.188493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:09.189350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 529/1066] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:09.194948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.267435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061623-5556-47a3-b614-7cc763de2f41 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.299777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902fd4-bac7-435f-937e-935651774b6c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.304818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.305500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.305782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.306057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.317586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.319029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.334920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.335544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.335830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:09.335931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:09.336749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:09.338000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:09.338000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:09.338000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:09.338000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:09.338221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.338221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:09.338221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.338596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.341940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 538/1067] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:09.342689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.352973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 530/1068] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:09.353834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.358710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.411941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.445644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f92b-f14e-4fdb-9c06-029cb655a010 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.456407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743efd7-685d-494c-9581-8f16be196e91 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.478018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.478628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.478908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.479182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.479865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:09.480169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.481570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bcf8f-ead8-40b1-a1be-d304145ee0cd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.489974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.490606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.490892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.491165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] PATH_INFO: `/v3/users/8153d4c2424742d7b2ba1dfe93a4835e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.492348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] RBAC: Authorizing `identity:get_user(user_id=8153d4c2424742d7b2ba1dfe93a4835e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.493812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.493910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 539/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:09.495025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462aec-8b6b-42b6-90cc-a8eb3085cc09 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.495310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462aec-8b6b-42b6-90cc-a8eb3085cc09 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.495585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462aec-8b6b-42b6-90cc-a8eb3085cc09 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.496961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 531/1070] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/users/8153d4c2424742d7b2ba1dfe93a4835e => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:09.497078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 540/1071] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:09.501851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.502135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.502236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.502412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.522970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:09.524470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:09.577361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.599189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 541/1072] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:09.613441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.623769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a027a72-eb46-40ca-a3f3-e5814eb255bd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.655823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.658407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.659181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.659463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.659738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.667422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.668855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:52:09.680273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:09.681509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 532/1073] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:09.682813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.704953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd39f-fb00-49c8-a828-e80923d296aa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.738311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.739472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.739749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.740016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.741160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.742607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.744266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 542/1074] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:09.745010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.779881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da432b4-ef9b-46bd-bb0a-d7972bcf15a5 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.810382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.816331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.817666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.817957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.818236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.850857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ea47b-1dd0-4eb9-b08c-e93a40c6998d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:09.877956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:09.888234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:09.888858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:09.889146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:09.889465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:09.890179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.890277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:09.890562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:09.891646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.891969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:09.909039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 543/1075] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:09.909836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:09.991076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 533/1076] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:09.991918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.009753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a9259-bc84-4a8a-8a6e-a09395b7b2d3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.021808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:10.043808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.044412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.044693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.044970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307/users/8153d4c2424742d7b2ba1dfe93a4835e/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.046940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=5320535831aa4a4e88f49faeb61a7307, user_id=8153d4c2424742d7b2ba1dfe93a4835e, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.048365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.062853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 544/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:52:09 2022] PUT /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307/users/8153d4c2424742d7b2ba1dfe93a4835e/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:52:10.070266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.097763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b06b5-1d84-4815-b629-8e0c0df22ecd None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.125062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:10.137447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.138109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.138416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.138641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.150234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.151712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:10.168645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:10.169702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:10.170573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:10.170573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:10.170573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:10.170573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:10.174847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 534/1078] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:10.175658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.191381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa8a6-6579-4c39-9757-0b3c53512b6c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.238643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.239833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.240111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.240509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.250900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.252430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:10.268461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:10.269420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:10.270371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:10.270371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:10.270371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:10.270371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:10.270371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 545/1079] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:10.274748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:10.275369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.294770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8162a7-1ee6-481b-b480-e62f7b61511d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.333786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.334413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.334701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.334987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.335683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:10.335993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.337414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.353789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 535/1080] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:10.355700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.380688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:10.388387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11213a9-b175-4021-a1f0-dc2ea33a5428 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.426772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.427394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.427673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.427945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.428635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:10.428945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.430345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.442092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 546/1081] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:10.469874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615b6-3e74-4137-9553-a4ffad5b679d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.509133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.509837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.510124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.510404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.518250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.519742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:52:10.533700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:10.534655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:10.536153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:10.540746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 536/1082] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:10.542076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.651312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbc509-b81f-44f7-ad37-6f1e0952e1ca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.686669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.687559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.687999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.688431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.689293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:10.689604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.691026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da11f-9c2b-43d7-ad54-dd6c23595e9d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.703813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 547/1083] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:10.710137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:10.714144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:10.815502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc448ba-d2a4-4628-a774-fea67244c819 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:10.848758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:10.849550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:10.849847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:10.850110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/2ea9da2bb11a496f836f9737227242a3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:10.852284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=be490d99a6d94f5ead55b8d35019ec9e, role_id=2ea9da2bb11a496f836f9737227242a3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:10.853761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35bc45-bac7-414f-8b67-337746f0ba4c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:10.866828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 537/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:52:10 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/be490d99a6d94f5ead55b8d35019ec9e/roles/2ea9da2bb11a496f836f9737227242a3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:52:12.060039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7bc0b-cf25-46b9-82ad-020bf4bfd3d7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.060619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7bc0b-cf25-46b9-82ad-020bf4bfd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.060619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7bc0b-cf25-46b9-82ad-020bf4bfd3d7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.061997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 548/1085] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:12.067798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.068216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.068420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.086351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:12.087526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:12.144135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:12.153540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 538/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:12.176805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7bc0b-cf25-46b9-82ad-020bf4bfd3d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:12.195722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:12.278456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7bc0b-cf25-46b9-82ad-020bf4bfd3d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:12.310738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:12.311369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.311647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.311918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.322584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:12.327405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:12.328456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:12.329337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 549/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:12.334972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:12.434069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7cb76-39e5-4769-83c5-de0c3d5eaf24 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:12.467758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:12.468524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.468812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.469093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.469848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:12.470158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:12.471533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:12.484399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 539/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:12.485594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:12.562029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:12.585627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28805-b09b-4f5d-b1cc-2dac469f5cd6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:12.618166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:12.618808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.619098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.619377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] PATH_INFO: `/v3/users/8153d4c2424742d7b2ba1dfe93a4835e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.620542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] RBAC: Authorizing `identity:get_user(user_id=8153d4c2424742d7b2ba1dfe93a4835e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:12.622021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb325546-a7a4-480d-988f-1f8de23a075a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:12.623640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 550/1089] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/users/8153d4c2424742d7b2ba1dfe93a4835e => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:12.629848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:12.685252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:12.728463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788ca4-da4c-436c-814c-da1b259abf2d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:12.762722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:12.763343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.763626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.763902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.830770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:12.832226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:12.838563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6010-641d-47ba-944b-d98bf66d5279 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.838851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6010-641d-47ba-944b-d98bf66d5279 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.839132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6010-641d-47ba-944b-d98bf66d5279 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.840491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 551/1090] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:52:12.845581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:12.845935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:12.846288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:12.864455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:12.865784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:12.892557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:12.934066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 552/1091] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:52:12.938274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 540/1092] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 19:52:12.944450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:12.957510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.017385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.042627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec884b-2bb7-43c2-a4b4-55e8e0357314 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.054680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e2eb-2b03-4109-a97a-4ca82fe3320d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.076734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.077414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.077709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.077973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.079128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.080558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.082255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 553/1093] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:13.088341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.089441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.090087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.090368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.090642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.101624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:13.106533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:13.107643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:13.108716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 541/1094] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 19:52:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:13.114021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.135864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.199424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab990c09-e3b4-470f-944a-20da330e149c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.218667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1809-9b47-45ef-8ddb-bde213f0e8d0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.232519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.233161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.233450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.233728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.234515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=5320535831aa4a4e88f49faeb61a7307, user.id=8153d4c2424742d7b2ba1dfe93a4835e) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:13.234837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.236327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.241975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 554/1095] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/role_assignments?user.id=8153d4c2424742d7b2ba1dfe93a4835e&scope.project.id=5320535831aa4a4e88f49faeb61a7307&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:13.252475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.253118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.253437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.253718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.255016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:13.255324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.256757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.266253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 542/1096] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:13.272941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.282408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.378110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffd7fd-3a95-4a59-b397-fa0f2a034896 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.414895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.415546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.415836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.416121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.426822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.428271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:13.442775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:13.443806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:13.445082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:13.445082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:13.445082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:13.445082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:13.445082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 555/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:13.450443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.537470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.560692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411173e2-65d9-4361-9821-75ee3048e10e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.593952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207219b-206f-4eba-8001-308549b24aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.594574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207219b-206f-4eba-8001-308549b24aea None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.594857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207219b-206f-4eba-8001-308549b24aea None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.595137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207219b-206f-4eba-8001-308549b24aea None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.595826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207219b-206f-4eba-8001-308549b24aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:13.596134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207219b-206f-4eba-8001-308549b24aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.597529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207219b-206f-4eba-8001-308549b24aea None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.609400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 543/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:13.615585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.673613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.715254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab50323-850c-400b-84a9-ae7e1981e814 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.748287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.748928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.749211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.749518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.757484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.758913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:52:13.769939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:13.771082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:13.777069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 556/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:13.777841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207219b-206f-4eba-8001-308549b24aea None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:13.891913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207219b-206f-4eba-8001-308549b24aea None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:13.926731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:13.927359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:13.927643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:13.927922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:13.928716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:13.929032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:13.930502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:13.938215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:13.949347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 544/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:13.955189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.055543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce6cc1-09c9-46ed-9827-7e495b6124c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.072167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:14.089070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:14.089704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:14.089987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:14.090263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:14.154888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:14.156360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:14.251572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 557/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:14.257249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.353461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c611673-53d6-4018-bafa-3531004fe39e None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.388694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:14.389362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:14.389643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:14.389916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:14.400224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:14.401697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:14.417317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:14.418229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:14.419097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:52:14.419097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:14.419097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:52:14.419097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:14.419097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 545/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:14.424100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.443503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:14.520855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7059f-2890-4a2b-aa25-7331a94dfbcf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.554038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:14.554662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:14.554948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:14.555230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:14.555925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:14.556235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:14.557633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:14.569279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 558/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:14.574950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.623573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:14.673481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c449-2099-44de-9b81-031592ee0ec8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.706192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:14.706830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:14.707135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:14.707415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:14.714214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:14.715919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:52:14.727516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:14.728564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:52:14.729637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:14.733522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 546/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:52:14.734508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.811363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:14.832599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3398cd6-8c6a-42aa-a159-474f5afd2034 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.866593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:14.867219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:14.867502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:14.867779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:14.868532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:14.868842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:14.870299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dccee-e1c3-4f8a-b81e-4bec529e5e24 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:14.882498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 559/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:52:14.888497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:14.986783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac1ba-5a67-4788-af8c-f101c34cbf69 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:14.995308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:15.020154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:15.020771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:15.021049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:15.021349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:15.022129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] RBAC: Adding query filter params (role.id=2ea9da2bb11a496f836f9737227242a3, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=be490d99a6d94f5ead55b8d35019ec9e) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:15.022436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:15.023849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d18f1-2004-461e-b4cd-d14a4ae3cafc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:15.029607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 547/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:14 2022] GET /identity/v3/role_assignments?user.id=be490d99a6d94f5ead55b8d35019ec9e&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=2ea9da2bb11a496f836f9737227242a3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:15.265602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012451a-956c-4c6e-881e-5459c65c31df None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:15.266088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012451a-956c-4c6e-881e-5459c65c31df None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:15.266088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012451a-956c-4c6e-881e-5459c65c31df None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:15.267443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 560/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:15.273230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:15.273729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:15.273878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:15.292762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:15.294005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:15.360927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 548/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:15.385576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012451a-956c-4c6e-881e-5459c65c31df None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:15.489493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012451a-956c-4c6e-881e-5459c65c31df None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:15.526754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:15.527369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:15.527663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:15.527950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:15.529174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:15.530746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337163ff-4cb9-48e7-b5ac-2900465c5779 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:15.532415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 561/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:15.539117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:15.648078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ccfe-c9b0-47c0-8368-f6ee5f947772 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:15.649849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:15.686124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:15.686755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:15.687037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:15.687317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:15.687999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:15.689458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13ee5a-27f0-4d72-834a-4ba7a983ba8d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:15.711720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 549/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:52:15 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:17.751625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0067e-9ba4-4168-abe0-285bcfd829a7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:17.752152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0067e-9ba4-4168-abe0-285bcfd829a7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:17.752152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0067e-9ba4-4168-abe0-285bcfd829a7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:17.753558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 562/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:17.758717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:17.759136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:17.759278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:17.776958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:17.778186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:17.846025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 550/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:17.869808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0067e-9ba4-4168-abe0-285bcfd829a7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:17.878611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:17.968083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0067e-9ba4-4168-abe0-285bcfd829a7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:18.002005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:18.002572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:18.002853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:18.003127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] PATH_INFO: `/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:18.004578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] RBAC: Authorizing `identity:get_role(role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:18.005972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:18.007300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 563/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:17 2022] GET /identity/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:18.013085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:18.099335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:18.111754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710b93-3351-4ffb-af1d-f0f07b235b44 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:18.144043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:18.145200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:18.145511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:18.145787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] PATH_INFO: `/v3/users/86a42b9d7e1646f3927063e9b616df7d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:18.158371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] RBAC: Authorizing `identity:get_user(user_id=86a42b9d7e1646f3927063e9b616df7d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:18.159800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:18.162007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 551/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:18 2022] GET /identity/v3/users/86a42b9d7e1646f3927063e9b616df7d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:18.167861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:18.239021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:18.262854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224739-0ff6-4dc6-8a97-45a4dba734c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:18.296189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:18.296788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:18.297069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:18.297369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:18.365531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:18.366985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:18.440783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:18.466482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 564/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:18.472371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:18.569411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6dd-b3c1-4a1f-a6de-e71c2bb0c05f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:18.602380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:18.603009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:18.603289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:18.603563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:18.604692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:18.606142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75c6a5-6fd0-4774-9024-018ea62e8baf None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:18.607780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 552/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:18 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:18.613834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:18.708916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bea43-81b9-4dbe-b86a-10e642983a25 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:18.741980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:18.742587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:18.742866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:18.743138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:18.743916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=5320535831aa4a4e88f49faeb61a7307, user.id=86a42b9d7e1646f3927063e9b616df7d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:18.744225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:18.745664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ab54e-679d-4f05-b6c0-b401a0e5aa4c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:18.750889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 565/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:18 2022] GET /identity/v3/role_assignments?user.id=86a42b9d7e1646f3927063e9b616df7d&scope.project.id=5320535831aa4a4e88f49faeb61a7307&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:20.695163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066867a-1dee-46da-9d8b-a7cde9addd2a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:20.695687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066867a-1dee-46da-9d8b-a7cde9addd2a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:20.695780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066867a-1dee-46da-9d8b-a7cde9addd2a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:20.697056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 553/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:20.702228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:20.702594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:20.702776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:20.720365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:20.721574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:20.751408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:20.788100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 566/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:20.810438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066867a-1dee-46da-9d8b-a7cde9addd2a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:20.825796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:20.911356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066867a-1dee-46da-9d8b-a7cde9addd2a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:20.944143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:20.944774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:20.945054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:20.945406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] PATH_INFO: `/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:20.946777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] RBAC: Authorizing `identity:get_role(role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:20.948172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:20.949530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 554/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:20 2022] GET /identity/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:20.955346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:21.051928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57949eeb-4e44-45db-b4bd-a6d6324f3c84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:21.084808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:21.085470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:21.085756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:21.086035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] PATH_INFO: `/v3/users/86a42b9d7e1646f3927063e9b616df7d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:21.087194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] RBAC: Authorizing `identity:get_user(user_id=86a42b9d7e1646f3927063e9b616df7d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:21.088629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:21.090243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 567/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:20 2022] GET /identity/v3/users/86a42b9d7e1646f3927063e9b616df7d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:21.095742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:21.175641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:21.193567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d1b3f-ba40-49c4-ad8c-96437b8a185d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:21.226449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:21.227021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:21.227305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:21.227584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:21.228730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:21.230186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda7eb5-7cc6-4594-aa74-bf2bac97d64e None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:21.231818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 555/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:21 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:21.237870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:21.271671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:21.336128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828461-05cf-410a-a340-615073dadb36 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:21.368427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:21.369083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:21.369398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:21.369677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307/users/86a42b9d7e1646f3927063e9b616df7d/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:21.371856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] RBAC: Authorizing `identity:create_grant(project_id=5320535831aa4a4e88f49faeb61a7307, user_id=86a42b9d7e1646f3927063e9b616df7d, role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:21.373288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3802c-c066-4cec-a371-02cbedf54515 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:21.386796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 568/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:52:21 2022] PUT /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307/users/86a42b9d7e1646f3927063e9b616df7d/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:52:23.348752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2da2-f79b-4bc4-829a-e5aceac0277d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:23.349339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2da2-f79b-4bc4-829a-e5aceac0277d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:23.349339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b2da2-f79b-4bc4-829a-e5aceac0277d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:23.350661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 556/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:23.355844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:23.356281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:23.356408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:23.374356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:23.375543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:23.440704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 569/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:23.464153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b2da2-f79b-4bc4-829a-e5aceac0277d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:23.563552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b2da2-f79b-4bc4-829a-e5aceac0277d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:23.596083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:23.596723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:23.597006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:23.597834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] PATH_INFO: `/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:23.599315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] RBAC: Authorizing `identity:get_role(role_id=7d3c1c57f0bf4f2294e974897b6327fb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:23.600997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:23.602355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 557/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:23 2022] GET /identity/v3/roles/7d3c1c57f0bf4f2294e974897b6327fb => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:23.608299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:23.634516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:23.704396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c808d7-22d8-4458-a56d-cbd7f435b4c8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:23.742801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:23.743446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:23.743731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:23.744011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] PATH_INFO: `/v3/users/86a42b9d7e1646f3927063e9b616df7d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:23.745942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] RBAC: Authorizing `identity:get_user(user_id=86a42b9d7e1646f3927063e9b616df7d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:23.747572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:23.749215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 570/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:23 2022] GET /identity/v3/users/86a42b9d7e1646f3927063e9b616df7d => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:23.755304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:23.779707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:23.871437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a26cb-f356-47be-99d6-c47453e99cdc None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:23.904541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:23.905166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:23.905478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:23.905759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:23.971666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:23.973680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:23.990562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:24.069849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 558/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:24.075683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:24.169178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:24.176209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f113a4a-14a7-4b4c-afeb-67740e1e3c82 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:24.208910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:24.209572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:24.209857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:24.210136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] PATH_INFO: `/v3/projects/5320535831aa4a4e88f49faeb61a7307` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:24.211281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] RBAC: Authorizing `identity:get_project(project_id=5320535831aa4a4e88f49faeb61a7307)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:24.212710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee79f7-9570-4395-b08d-73a320153208 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:24.214405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 571/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:24 2022] GET /identity/v3/projects/5320535831aa4a4e88f49faeb61a7307 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:24.220632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:24.317789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035e21a-a8e0-4b64-bf58-8823052666e7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:24.334785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:24.351919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:24.352520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:24.352800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:24.353077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:24.353898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] RBAC: Adding query filter params (role.id=7d3c1c57f0bf4f2294e974897b6327fb, scope.project.id=5320535831aa4a4e88f49faeb61a7307, user.id=86a42b9d7e1646f3927063e9b616df7d) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:24.354214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:24.355630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd235b-11bd-4611-8c47-47811f3daa4d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:24.361200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 559/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:24 2022] GET /identity/v3/role_assignments?user.id=86a42b9d7e1646f3927063e9b616df7d&scope.project.id=5320535831aa4a4e88f49faeb61a7307&role.id=7d3c1c57f0bf4f2294e974897b6327fb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:26.345807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326299-7c54-47b0-95a2-e070be3e6416 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:26.346339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326299-7c54-47b0-95a2-e070be3e6416 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:26.346443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326299-7c54-47b0-95a2-e070be3e6416 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:26.347718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 572/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:26.352729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:26.353169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:26.353307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:26.371404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:26.372570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:26.436793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 560/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:26.459425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326299-7c54-47b0-95a2-e070be3e6416 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:26.558802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326299-7c54-47b0-95a2-e070be3e6416 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:26.592203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:26.592835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:26.593122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:26.593438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:26.594595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:26.596068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fecdb-4168-43f6-bd6f-3214802eb871 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:26.598160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 573/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:26.604321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:26.700314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d2e57-aef4-4335-80df-7686daeadb42 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:26.712879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:26.734235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:26.734850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:26.735133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:26.735412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:26.736091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:26.737566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c64a-db50-49af-b5ab-808140ed8c5f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:26.763445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 561/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:52:26 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:52:28.777449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f544cd-f583-43cd-91c7-fc25dd2810be None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:28.778022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f544cd-f583-43cd-91c7-fc25dd2810be None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:28.778022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f544cd-f583-43cd-91c7-fc25dd2810be None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:28.779371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 574/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:28.784713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:28.785137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:28.785248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:28.803729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:28.804915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:28.871852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 562/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:28.895570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f544cd-f583-43cd-91c7-fc25dd2810be None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:28.925805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:28.995774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f544cd-f583-43cd-91c7-fc25dd2810be None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:29.029069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:29.029662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:29.029941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:29.030214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:29.031345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:29.032756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff8fa4-fdc7-45e9-8fd1-32821c004081 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:29.034346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 575/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:29.040345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:29.136097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:29.144675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111cb6c-4d77-49b7-b776-28f80ba39b6d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:29.177661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:29.178276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:29.178562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:29.178838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:29.179530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:29.180953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a59de-2713-49e8-a6ec-86bd304a0caa None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:29.201252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 563/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:52:29 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:31.225788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ee0c-accc-4645-a2cb-40389ce725d1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.226287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ee0c-accc-4645-a2cb-40389ce725d1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.226287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3ee0c-accc-4645-a2cb-40389ce725d1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.227589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 576/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:31.232683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.233068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.233240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.250986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:31.252171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:31.318294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 564/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:31.341361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ee0c-accc-4645-a2cb-40389ce725d1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:31.435615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:31.441316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3ee0c-accc-4645-a2cb-40389ce725d1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:31.473081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:31.473734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.474018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.474293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.484024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:31.493019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:31.494263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:31.495518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 577/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:31.500799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:31.579915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:31.598914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b19ab-ff21-44ef-89ba-0579d13b9308 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:31.632172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:31.632779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.633060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.633358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.634065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:31.634369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:31.635724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:31.643518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 565/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:31.649394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:31.746262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4494-f0b5-41f2-a1bf-563d0ab18963 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:31.779136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:31.779774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.780085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.780342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] PATH_INFO: `/v3/users/a3e899c5c31f4bc7af6234ea64977bf9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.794341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] RBAC: Authorizing `identity:get_user(user_id=a3e899c5c31f4bc7af6234ea64977bf9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:31.795789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:31.797508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 578/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:31 2022] GET /identity/v3/users/a3e899c5c31f4bc7af6234ea64977bf9 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:31.803867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:31.907309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0575a24-3c90-45f0-add1-49bb8dc4a31d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:31.940871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:31.941519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:31.941805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:31.942083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:31.953442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:32.007604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:32.008974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:32.104773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 566/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:32.110644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:32.128544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:32.212480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f3543-a5bc-431f-a2b0-cc7307731bee None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:32.247048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:32.247695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:32.247983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:32.248264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] PATH_INFO: `/v3/projects/80b6d427fc634779ae03ca755437849e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:32.249475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] RBAC: Authorizing `identity:get_project(project_id=80b6d427fc634779ae03ca755437849e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:32.250908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d09e-bb6c-46c1-8d4b-fa63be053772 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:32.252584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 579/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:32 2022] GET /identity/v3/projects/80b6d427fc634779ae03ca755437849e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:32.259432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:32.301899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:32.355924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dc8a8-82b7-4b82-89a0-60db4fd19771 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:32.389068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:32.389705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:32.389985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:32.390254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:32.391023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=80b6d427fc634779ae03ca755437849e, user.id=a3e899c5c31f4bc7af6234ea64977bf9) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:32.391327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:32.392729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864e59-164d-49a9-80e4-5ae02e26f416 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:32.397929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 567/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:32 2022] GET /identity/v3/role_assignments?user.id=a3e899c5c31f4bc7af6234ea64977bf9&scope.project.id=80b6d427fc634779ae03ca755437849e&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:34.364673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921242-3be8-49f1-9e74-1804b6fc8978 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:34.365183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921242-3be8-49f1-9e74-1804b6fc8978 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:34.365320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921242-3be8-49f1-9e74-1804b6fc8978 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:34.366623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 580/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:34.371882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:34.372289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:34.372430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:34.390535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:34.391698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:34.456129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 568/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:34.477716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921242-3be8-49f1-9e74-1804b6fc8978 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:34.562928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:34.583446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921242-3be8-49f1-9e74-1804b6fc8978 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:34.617336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:34.617929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:34.618216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:34.618498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:34.628256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:34.633146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:34.634240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:34.635279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 581/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:34.640514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:34.674607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:34.737652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c06b5-700a-4a3b-8ac7-b89e855b0567 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:34.770569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:34.771182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:34.771465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:34.771742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:34.772450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:34.772758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:34.774152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:34.781924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 569/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:34.788594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:34.889697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857efdd-e251-4e33-9cbe-daf659b66c57 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:34.923976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099818f-2711-4465-9284-15b803110031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:34.924610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099818f-2711-4465-9284-15b803110031 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:34.924895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099818f-2711-4465-9284-15b803110031 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:34.925173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099818f-2711-4465-9284-15b803110031 None admin] PATH_INFO: `/v3/users/a3e899c5c31f4bc7af6234ea64977bf9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:34.926357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099818f-2711-4465-9284-15b803110031 None admin] RBAC: Authorizing `identity:get_user(user_id=a3e899c5c31f4bc7af6234ea64977bf9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:34.927784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099818f-2711-4465-9284-15b803110031 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:34.929393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 582/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:34 2022] GET /identity/v3/users/a3e899c5c31f4bc7af6234ea64977bf9 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:34.935170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:35.029187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:35.033624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f5461-7efd-4ae1-aef8-75943bfc8c7b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:35.066724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:35.067351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:35.067636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:35.067913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] PATH_INFO: `/v3/projects/80b6d427fc634779ae03ca755437849e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:35.069051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] RBAC: Authorizing `identity:get_project(project_id=80b6d427fc634779ae03ca755437849e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:35.070507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ff20f-9051-4ad9-9310-69262aa43d11 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:35.072171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 570/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:34 2022] GET /identity/v3/projects/80b6d427fc634779ae03ca755437849e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:35.078103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099818f-2711-4465-9284-15b803110031 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:35.092989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:35.175362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099818f-2711-4465-9284-15b803110031 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:35.208237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:35.208887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:35.209170 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:35.209475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] PATH_INFO: `/v3/projects/80b6d427fc634779ae03ca755437849e/users/a3e899c5c31f4bc7af6234ea64977bf9/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:35.211383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=80b6d427fc634779ae03ca755437849e, user_id=a3e899c5c31f4bc7af6234ea64977bf9, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:35.212803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ddaf-d798-486f-8054-cf884a7aa0d7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:35.226351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 583/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:52:35 2022] PUT /identity/v3/projects/80b6d427fc634779ae03ca755437849e/users/a3e899c5c31f4bc7af6234ea64977bf9/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:52:37.200790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4d8d-fb74-400f-8385-8493f1551234 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.201360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4d8d-fb74-400f-8385-8493f1551234 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.201360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e4d8d-fb74-400f-8385-8493f1551234 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.202748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 571/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:37.207911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.208306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.208472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.227809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:37.228996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:37.296450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 584/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:37.320539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4d8d-fb74-400f-8385-8493f1551234 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:37.420906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e4d8d-fb74-400f-8385-8493f1551234 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:37.460196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:37.460759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.461042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.461347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.471254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:37.476684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:37.477824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:37.478828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 572/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:37.484639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:37.486844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:37.592172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fd599-871b-4d28-bb0d-3e4347bacba6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:37.628639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:37.629253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.629568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.629847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.630561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:37.630870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:37.632242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:37.640218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 585/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:37.646567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:37.674882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:37.748367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8039-7aa5-41ef-b7c8-f8ae3fa52f5f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:37.782444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:37.783106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.783394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.783670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] PATH_INFO: `/v3/users/a3e899c5c31f4bc7af6234ea64977bf9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.785444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] RBAC: Authorizing `identity:get_user(user_id=a3e899c5c31f4bc7af6234ea64977bf9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:37.786879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:37.788722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 573/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:37 2022] GET /identity/v3/users/a3e899c5c31f4bc7af6234ea64977bf9 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:37.794647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:37.855237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:37.892817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc7cc-40e4-4bb0-92c8-953fc89527a9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:37.927988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:37.928594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:37.928873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:37.929163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:37.993625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:37.995041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:38.052689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:38.090370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 586/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:38.096330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:38.188425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:38.195840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585901-78c1-41f3-9434-5b20e3c8cb7d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:38.228818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:38.229479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:38.229760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:38.230035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] PATH_INFO: `/v3/projects/80b6d427fc634779ae03ca755437849e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:38.231180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] RBAC: Authorizing `identity:get_project(project_id=80b6d427fc634779ae03ca755437849e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:38.232610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdd507-0565-4c44-afdc-5d2b0ff4f550 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:38.234271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 574/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:38 2022] GET /identity/v3/projects/80b6d427fc634779ae03ca755437849e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:38.240369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:38.336401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc33406-94a2-4a4e-b304-00ea0ce44c15 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:38.368995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:38.369625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:38.369908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:38.370182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:38.370975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=80b6d427fc634779ae03ca755437849e, user.id=a3e899c5c31f4bc7af6234ea64977bf9) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:38.371291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:38.372724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983639e-e7b2-4cad-b2e7-a1aa607c4fe3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:38.378350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 587/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:38 2022] GET /identity/v3/role_assignments?user.id=a3e899c5c31f4bc7af6234ea64977bf9&scope.project.id=80b6d427fc634779ae03ca755437849e&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:40.386088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271d69-6c44-4bd5-b9cd-6a67736b0363 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:40.386600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271d69-6c44-4bd5-b9cd-6a67736b0363 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:40.386708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271d69-6c44-4bd5-b9cd-6a67736b0363 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:40.387967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 575/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:40.392984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:40.393951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:40.394209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:40.411643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:40.412810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:40.435204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:40.477432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 588/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:40.499036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271d69-6c44-4bd5-b9cd-6a67736b0363 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:40.598482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271d69-6c44-4bd5-b9cd-6a67736b0363 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:40.631399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:40.632004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:40.632283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:40.632560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:40.661286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:40.698541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:40.699970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:40.792882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 576/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:40.798893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:40.894823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d267bd-61d4-4705-8315-f44b89eae6a5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:40.937506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:40.938095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:40.938383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:40.938666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:40.945117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:40.946586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d66902e6-0418-49a3-a56b-a8ff30cfae02 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:40.957821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:40.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:40.959931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 589/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:52:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:40.965021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:41.024350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:41.063444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae686ed6-2140-4d9b-b0a4-f57c3d8afd5b None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:41.096744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:41.097389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:41.097678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:41.097958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:41.098647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:41.098958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:41.100324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7946fb2-68b7-4f86-9ed4-3d7a4dcd8056 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:41.107338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 577/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 19:52:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:43.058923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d907b-ca8c-40bd-be40-216463d3f1fc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:43.059428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d907b-ca8c-40bd-be40-216463d3f1fc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:43.059544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d907b-ca8c-40bd-be40-216463d3f1fc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:43.060837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 590/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:52:43.066483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e014b-2861-4c76-a4b7-bcf4bd8f9bb2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:43.066896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e014b-2861-4c76-a4b7-bcf4bd8f9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:43.067041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e014b-2861-4c76-a4b7-bcf4bd8f9bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:43.085308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a20e014b-2861-4c76-a4b7-bcf4bd8f9bb2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:43.086485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a20e014b-2861-4c76-a4b7-bcf4bd8f9bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:43.150286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 578/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:43.173386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d907b-ca8c-40bd-be40-216463d3f1fc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:43.192518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:43.272313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d907b-ca8c-40bd-be40-216463d3f1fc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:43.305040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:43.305671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:43.305959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:43.306265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:43.306967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:43.308330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b1d9-4d3a-4acb-bf91-3ab11947cd5c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:43.323804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 591/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 19:52:43 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:45.332593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c6af-8ccb-4e8b-a63f-6df2b2ce4f0f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:45.333116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c6af-8ccb-4e8b-a63f-6df2b2ce4f0f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:45.333116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c6af-8ccb-4e8b-a63f-6df2b2ce4f0f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:45.334675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 579/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:45.339850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:45.340247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:45.340402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:45.358335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:45.359509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:45.422767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 592/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:45.445490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99c6af-8ccb-4e8b-a63f-6df2b2ce4f0f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:45.500871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:45.543476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99c6af-8ccb-4e8b-a63f-6df2b2ce4f0f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:45.575805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:45.576433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:45.576713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:45.576991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] PATH_INFO: `/v3/domains/d5671a214adb401b846da9f7d6718811` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:45.587116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d5671a214adb401b846da9f7d6718811)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:45.588553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6b359-ed10-4019-83c6-381d45776684 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:45.590154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 580/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 19:52:45 2022] GET /identity/v3/domains/d5671a214adb401b846da9f7d6718811 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:45.596586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:45.606369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:45.699261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba62098-5838-4d92-aa0a-80d8d9235c63 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:45.734251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:45.734858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:45.735142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:45.735420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:45.736101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:45.737574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74f9a-1f6c-463f-bd53-40f89919eca3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:45.763164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 593/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:52:45 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:47.777053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498a69-b092-43f0-95ef-6f19ff8dd91a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:47.777640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498a69-b092-43f0-95ef-6f19ff8dd91a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:47.777640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498a69-b092-43f0-95ef-6f19ff8dd91a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:47.778976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 581/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:47.784034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:47.784478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:47.784607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:47.802612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:47.803802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:47.859052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:47.871542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 594/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:47.895251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59498a69-b092-43f0-95ef-6f19ff8dd91a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:47.999654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59498a69-b092-43f0-95ef-6f19ff8dd91a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:48.019277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:48.037523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:48.038352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:48.038636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:48.038912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] PATH_INFO: `/v3/domains/d5671a214adb401b846da9f7d6718811` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:48.040057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d5671a214adb401b846da9f7d6718811)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:48.041531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa271fc-20e2-4a27-b3ee-aed7e55dc6b8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:48.043110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 582/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 19:52:47 2022] GET /identity/v3/domains/d5671a214adb401b846da9f7d6718811 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:48.048838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:48.143308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb932e-848d-4be2-a764-2591beeaa841 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:48.175929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:48.176535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:48.176820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:48.177097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:48.177807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:48.179229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b067b5-b03c-4a3d-b324-e5d4f2778e39 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:48.199252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 595/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:52:48 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:52:50.238873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9cbba-ae8e-4c44-86dc-ae96d4e284ff None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.239376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9cbba-ae8e-4c44-86dc-ae96d4e284ff None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.239376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9cbba-ae8e-4c44-86dc-ae96d4e284ff None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:50.240699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 583/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:50.245982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.246392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.246550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:50.264822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:50.266050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:50.306438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:50.331316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 596/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:50.353767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9cbba-ae8e-4c44-86dc-ae96d4e284ff None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:50.458096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9cbba-ae8e-4c44-86dc-ae96d4e284ff None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:50.490859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:50.491425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.491706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.491988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:50.502818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:50.507717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:50.508854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:50.509942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 584/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:50.514916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:50.612155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1770f-ebdd-43d6-8aa8-ebbce9ac77d1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:50.644284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:50.644892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.645179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.645486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:50.646199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:50.646510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:50.647869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:50.655651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 597/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:50.661965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:50.707415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:50.760415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406234a3-921b-411c-b729-31fcb140f055 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:50.794089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:50.794713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.794994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.795268 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] PATH_INFO: `/v3/users/bd1856bf6d2c40e69e27589a8b0415e3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:50.808958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] RBAC: Authorizing `identity:get_user(user_id=bd1856bf6d2c40e69e27589a8b0415e3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:50.810425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:50.812003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 585/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:50 2022] GET /identity/v3/users/bd1856bf6d2c40e69e27589a8b0415e3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:50.817736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:50.856834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:50.917109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b154dc-fdf2-4a0e-a628-e31210409126 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:50.956348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:50.956970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:50.957258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:50.957569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:51.022303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:51.023681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:51.060922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:51.119218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 598/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:51.125140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:51.222917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671790b-53cc-4cb9-a6d1-dea4206d7880 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:51.224411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:51.256476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:51.257108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:51.257420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:51.257697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] PATH_INFO: `/v3/projects/6f5a470c24344b7698b42bc8ca237361` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:51.258841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] RBAC: Authorizing `identity:get_project(project_id=6f5a470c24344b7698b42bc8ca237361)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:51.260265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160b713-fd6a-4fd2-9226-dea01f3c39ab None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:51.261929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 586/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:51 2022] GET /identity/v3/projects/6f5a470c24344b7698b42bc8ca237361 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:51.268596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:51.364110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035409-800b-4497-9d7a-1b9336f552fe None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:51.397551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:51.398156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:51.398441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:51.398719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:51.399505 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=6f5a470c24344b7698b42bc8ca237361, user.id=bd1856bf6d2c40e69e27589a8b0415e3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:51.399820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:51.401238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6552a77-9e30-4e4b-9e2e-f2c9ce343432 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:51.406566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 599/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:51 2022] GET /identity/v3/role_assignments?user.id=bd1856bf6d2c40e69e27589a8b0415e3&scope.project.id=6f5a470c24344b7698b42bc8ca237361&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:53.376786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2169b6-d379-4da0-8251-77333e934091 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:53.377495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2169b6-d379-4da0-8251-77333e934091 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:53.377495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2169b6-d379-4da0-8251-77333e934091 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:53.378794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 587/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:53.384025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:53.384444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:53.384590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:53.390911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:53.403820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:53.405001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:53.468673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 600/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:53.491255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2169b6-d379-4da0-8251-77333e934091 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:53.589554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2169b6-d379-4da0-8251-77333e934091 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:53.621377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:53.622001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:53.622282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:53.622555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:53.632902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:53.637700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:53.638862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:52:53.640179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 588/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:53.644723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:53.740109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ffd8d-aec6-4631-8b22-919889ab7c6f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:53.768230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:53.773413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:53.774022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:53.774304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:53.774578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:53.775304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:53.775611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:53.776963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:53.785389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 601/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:53.791557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:53.822958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:53.891493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e79c-71c2-4ce8-b93a-7fa748b62ab2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:53.924905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:53.925571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:53.925863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:53.926143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] PATH_INFO: `/v3/users/bd1856bf6d2c40e69e27589a8b0415e3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:53.927295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] RBAC: Authorizing `identity:get_user(user_id=bd1856bf6d2c40e69e27589a8b0415e3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:53.928729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:53.930346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 589/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:53 2022] GET /identity/v3/users/bd1856bf6d2c40e69e27589a8b0415e3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:53.936043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:54.032091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd352af-e16a-4b32-bd63-afdd5b1515a8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:54.064624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:54.065258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:54.065577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:54.065856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] PATH_INFO: `/v3/projects/6f5a470c24344b7698b42bc8ca237361` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:54.066999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] RBAC: Authorizing `identity:get_project(project_id=6f5a470c24344b7698b42bc8ca237361)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:54.068419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef8571-f753-43f3-a9a1-2f3970b80a43 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:54.070101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 602/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:53 2022] GET /identity/v3/projects/6f5a470c24344b7698b42bc8ca237361 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:54.076237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:54.172852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:54.177210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2342e9b-3f26-4928-bbbc-3b634737deb8 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:54.210122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:54.210784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:54.211067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:54.211345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] PATH_INFO: `/v3/projects/6f5a470c24344b7698b42bc8ca237361/users/bd1856bf6d2c40e69e27589a8b0415e3/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:54.213286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] RBAC: Authorizing `identity:create_grant(project_id=6f5a470c24344b7698b42bc8ca237361, user_id=bd1856bf6d2c40e69e27589a8b0415e3, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:54.214716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3b091-5b08-48ce-a253-1ddc388993fc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:54.227044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 590/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:52:54 2022] PUT /identity/v3/projects/6f5a470c24344b7698b42bc8ca237361/users/bd1856bf6d2c40e69e27589a8b0415e3/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:52:56.201548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479ca1-8f0e-473a-98f1-69b1a8d0b71b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.202055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479ca1-8f0e-473a-98f1-69b1a8d0b71b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.202055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479ca1-8f0e-473a-98f1-69b1a8d0b71b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.203370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 603/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:52:56.208469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.208856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.209035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.226738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:52:56.227922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:52:56.293804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 591/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:52:56.317218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479ca1-8f0e-473a-98f1-69b1a8d0b71b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:56.377890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:56.415841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479ca1-8f0e-473a-98f1-69b1a8d0b71b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:56.452253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:56.452813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.453097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.453409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.464278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:52:56.469215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:52:56.470322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:52:56.471206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 604/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:52:56.476442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:56.561157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:56.574015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4b5f-2624-4f51-8237-07b48e436edb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:56.606291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:56.606898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.607174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.607442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.608275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:56.608579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:56.609958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:56.617698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 592/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:56.623396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:56.720945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6dfd7-20c9-4e56-bd1e-70ff0b2db6a1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:56.742294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:56.754510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:56.755140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.755422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.755700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] PATH_INFO: `/v3/users/bd1856bf6d2c40e69e27589a8b0415e3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.757083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=bd1856bf6d2c40e69e27589a8b0415e3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:56.758540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:56.760125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 605/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 19:52:56 2022] GET /identity/v3/users/bd1856bf6d2c40e69e27589a8b0415e3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:56.765913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:56.863775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161415a3-41ad-454e-b4ae-ef11dfa774e4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:56.895925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:56.896551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:56.896833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:56.897111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:56.915535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:56.963257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:56.964704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:57.059433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 593/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:52:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:52:57.065398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:57.161241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b59f3-c654-45c9-87c6-6899c0fe4cb0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:57.193033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:57.193761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:57.194039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:57.194309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] PATH_INFO: `/v3/projects/6f5a470c24344b7698b42bc8ca237361` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:57.195443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] RBAC: Authorizing `identity:get_project(project_id=6f5a470c24344b7698b42bc8ca237361)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:57.196853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16218540-f03e-42b0-a5f8-f953572faffd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:57.198523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 606/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 19:52:57 2022] GET /identity/v3/projects/6f5a470c24344b7698b42bc8ca237361 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:52:57.204627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:52:57.252956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:57.301787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0a68-34e7-4a3b-89c1-eb0246df26d4 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:52:57.334860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:52:57.335476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:52:57.335758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:52:57.336034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:52:57.336819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=6f5a470c24344b7698b42bc8ca237361, user.id=bd1856bf6d2c40e69e27589a8b0415e3) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:52:57.337130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:52:57.338577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70035a23-14ce-4332-9ede-d33583dbef31 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:52:57.344161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 594/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:52:57 2022] GET /identity/v3/role_assignments?user.id=bd1856bf6d2c40e69e27589a8b0415e3&scope.project.id=6f5a470c24344b7698b42bc8ca237361&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:07.189632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=71 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:07.341643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=43 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:51.720538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fac68-0b99-4f7b-93d6-b7744a0d2749 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:51.721160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fac68-0b99-4f7b-93d6-b7744a0d2749 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:51.721160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fac68-0b99-4f7b-93d6-b7744a0d2749 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:51.725327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 607/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:53:51.729564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:51.729564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:51.729564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:51.749883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:53:51.751101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:53:51.845120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 595/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:53:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:53:51.866274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fac68-0b99-4f7b-93d6-b7744a0d2749 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:52.020097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fac68-0b99-4f7b-93d6-b7744a0d2749 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:52.064647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:52.065469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:52.065760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:52.066060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:52.083681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:52.085710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:53:52.104184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:52.105295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:52.110516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:53:52.110516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:53:52.110516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:52.110516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:53:52.110516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 608/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:52.114208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:52.255547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978157-58f1-44c8-96ba-dcfcbb4bc753 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:52.307059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:52.313877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:52.314552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:52.314870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:52.315085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:52.315871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:52.316330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:52.317796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92869c-3b4f-45b8-980a-f6c339120edc None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:52.329913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 596/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:52.336980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:52.415410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:52.488038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796253-b4f1-4dc6-86ae-92dd3356cf0c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:52.534647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:52.535416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:52.535807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:52.536360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:52.537326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:52.539276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c67f5-c500-402d-9306-2d734a924c34 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:52.568828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 609/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 19:53:52 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 19:53:54.783988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6cdc7-e72e-4759-baba-f72250d52099 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:54.784562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6cdc7-e72e-4759-baba-f72250d52099 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:54.784562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6cdc7-e72e-4759-baba-f72250d52099 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:54.786666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 597/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:53:54.791748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:54.792216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:54.792303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:54.812319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:53:54.814047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:53:54.887438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 610/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:53:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:53:54.910594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6cdc7-e72e-4759-baba-f72250d52099 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:55.038696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6cdc7-e72e-4759-baba-f72250d52099 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:55.082251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:55.082988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:55.083267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:55.083541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:55.095190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:53:55.100031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:55.101038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:53:55.102182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 598/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:55.107339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:55.149811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:55.224917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635a2b4-de0a-4bc5-b0f4-91af617d7b6b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:55.267001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:55.267606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:55.267889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:55.268165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:55.268882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:55.269192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:55.270634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:55.281316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 611/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:55.285099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:55.344493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:55.414896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81fb1-0cdf-4079-9d7b-3022cc01bd92 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:55.464235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:55.465065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:55.465587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:55.465910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:55.480836 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:55.482510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:53:55.502856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:55.504172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:55.505246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:53:55.505246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:53:55.505246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:55.505246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:53:55.505246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 599/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:55.510542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:55.636506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:55.640876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0a3d-9f98-4914-a5b4-cd903dabcd8e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:55.681480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:55.682119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:55.682454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:55.682978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:55.683538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:55.683881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:55.685349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:55.701061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 612/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:55.707754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:55.821903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96c77-1b6a-4828-9c6b-2a31e2def7ee None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:55.823798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:55.863722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:55.864437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:55.864708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:55.865042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:55.873303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:55.874860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:53:55.887206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:55.893300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:53:55.894393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 600/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:53:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:55.895016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:56.006494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988c11-4fd2-4083-8da7-c3c39e627154 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:56.050110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:56.050734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:56.051018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:56.051301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:56.052242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:56.052661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:56.054845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:56.075207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 613/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:53:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:56.081142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:56.195181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad283c1-c363-4097-84a2-f5868e649b52 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:56.233432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:56.234049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:56.234326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:56.234638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:56.266478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:56.309946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:56.311573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:56.431020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 601/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:53:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:53:56.437874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:56.458292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:56.552561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec060e2-b833-4562-b348-f2af75da74c7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:56.593509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:56.594256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:56.594556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:56.594816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:56.606261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:56.608421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:53:56.623990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:56.625164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:56.630460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:53:56.630460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:53:56.630460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:53:56.630460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:53:56.630460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 614/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:53:56.632745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:56.705178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:56.760326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226f61-ddb1-4971-8ad4-3e5814d40ea7 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:56.802565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:56.803198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:56.803475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:56.803753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:56.804450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:56.804763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:56.806301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:56.829296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 602/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:56.829974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:56.918438 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:56.959378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4ae1-eb9a-42a5-aba1-b1831eb79a7b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:57.002077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:57.002811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:57.003157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:57.003500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:57.010294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:57.011845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:53:57.024285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:57.025495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:53:57.026672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:53:57.027736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 615/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:57.034527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:57.147005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3594-976a-488f-af7a-b390fbd7b596 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:57.173537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:57.188038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:57.188897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:57.189365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:57.189746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:57.190650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:57.191129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:57.192742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c38e-16c0-4519-93f2-905aa8d19e15 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:57.211935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 603/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:57.213778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:57.337161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90c8b2-9046-4911-8aae-8459b593bef3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:57.373648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:57.383825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:57.384549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:57.385504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:57.385961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:57.387132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:57.387524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:57.391411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444e8dc-ef08-4dc5-b0fb-0258c0ceefc4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:57.406971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 616/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:53:57 2022] GET /identity/v3/role_assignments?user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:59.498688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe457-c409-40b0-9f78-4fd402149e3e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:59.499343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe457-c409-40b0-9f78-4fd402149e3e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:59.499343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe457-c409-40b0-9f78-4fd402149e3e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:59.500841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 604/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:53:59.507477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:59.507933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:59.508075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:59.527184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:53:59.528489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:53:59.610026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 617/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:53:59.636564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe457-c409-40b0-9f78-4fd402149e3e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:59.743159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe457-c409-40b0-9f78-4fd402149e3e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:59.777336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:59.778010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:59.778362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:59.778708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:59.790976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:53:59.797669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:53:59.798754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:53:59.799751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 605/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:53:59.806531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:53:59.933242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f3ee-1b81-484d-8d75-58183737db79 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:53:59.957542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:53:59.969442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:53:59.970057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:53:59.970341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:53:59.970619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:53:59.971445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:53:59.971753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:53:59.973117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:53:59.980941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 618/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:53:59.987880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:00.034586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:00.097332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046aceb-422d-4b03-ae83-49d4e63e517f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:00.132570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:00.133406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:00.133694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:00.133969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:00.146417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:00.150307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:00.166888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:00.167977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:00.174010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:00.174010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:00.174010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:00.174010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:00.174010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 606/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:00.174364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:00.284499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd350a4-cf4e-4d9b-818e-efd5914bcdcf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:00.320840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:00.321451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:00.321753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:00.322061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:00.322933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:00.323345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:00.325015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:00.338970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 619/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:00.345956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:00.443749 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:00.451733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a083b5-f729-4376-bf47-0871fd818fc3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:00.486938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:00.487573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:00.487920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:00.488201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:00.496258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:00.497879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:54:00.509883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:00.511444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:00.512464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 607/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:00.518084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:00.578010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:00.641819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a850cb-571a-47ef-ac6f-57e6658ca353 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:00.683619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:00.684247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:00.684531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:00.684808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:00.685647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:00.685958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:00.687459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:00.716712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 620/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:54:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:00.718281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:00.834081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13e1bc-e59c-4776-85de-6b5dbcf9c8fb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:00.871716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:00.872665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:00.873163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:00.874076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:00.887253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:00.890660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:00.906678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:00.913530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:00.914810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:00.914810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:00.914810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:00.914810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:00.914810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 608/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:00.916220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:01.040735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a2ad-0c20-4122-af4e-8fbb08c001db None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:01.043104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:01.081536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:01.082165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:01.082450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:01.082731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:01.083485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:01.083801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:01.085242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:01.096785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 621/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:01.102730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:01.112756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:01.217607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9f94f-d644-4322-bc16-469fe6c10637 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:01.254538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:01.255165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:01.255448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:01.255727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:01.263390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:01.265790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:54:01.278568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:01.279955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:01.281213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:01.284690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 609/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:01.286101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:01.400303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ec81-a2e0-433f-90a1-38f6a8409911 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:01.437819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:01.438470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:01.438723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:01.439139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:01.439985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:01.440403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:01.442021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d000-24b8-4b60-8c86-fb8b64caea79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:01.456917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 622/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:54:01.463150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:01.536112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:01.575631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac72bc-2409-447d-b9aa-326390f521de None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:01.616693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:01.617494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:01.617803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:01.618115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/845ce3ae6fd44a66b9fbe5a9c12e7eac/roles/4a74a82a0c4e47ea8120a7f749ff9bd6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:01.634716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=845ce3ae6fd44a66b9fbe5a9c12e7eac, role_id=4a74a82a0c4e47ea8120a7f749ff9bd6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:01.636250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113c7c-0578-45bc-bc5a-1393a77c6b19 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:01.649887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 610/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:54:01 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/845ce3ae6fd44a66b9fbe5a9c12e7eac/roles/4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:54:03.660655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd34e0-cfc0-4529-9e32-c2b43c2797a0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:03.661490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd34e0-cfc0-4529-9e32-c2b43c2797a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:03.661490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd34e0-cfc0-4529-9e32-c2b43c2797a0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:03.662866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 623/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:03.668811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:03.669239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:03.669587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:03.691644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:03.692984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:03.764277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 611/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:03.788533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd34e0-cfc0-4529-9e32-c2b43c2797a0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:03.816652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:03.907361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd34e0-cfc0-4529-9e32-c2b43c2797a0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:03.945137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:03.945745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:03.946036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:03.946312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:03.957427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:54:03.962737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:03.963943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:03.964787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 624/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 19:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:03.971764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.020604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:04.077988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af333e-f186-4d12-adc0-f03d223e6175 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:04.120457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:04.121093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:04.123115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:04.123115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:04.123115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:04.123115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:04.124239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:04.137296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 612/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 19:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:54:04.140188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.241732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:04.258341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394df6-c677-43d8-827e-48d38cae04fb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:04.302031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:04.302862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:04.303211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:04.303768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:04.315740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:04.317197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:04.332786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:04.333904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:04.334905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:04.334905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:04.334905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:04.334905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:04.334905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 625/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:04.339772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.447078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64034be-6375-4783-b8b6-58c1882bf7e3 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:04.457100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:04.483944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:04.484567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:04.484938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:04.485177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:04.485961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:04.486271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:04.487769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:04.501375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 613/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:04.506232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.622400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e332de-a0a5-4726-b382-af2309e0e4d0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:04.658467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:04.659123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:04.659408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:04.659688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:04.662840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:04.668564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:04.670679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:54:04.682172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:04.683171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:04.684137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 626/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:04.689339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.797122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773064d7-bb6f-41b2-9f1e-c2a2dc062f5c None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:04.834238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:04.834895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:04.835181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:04.835457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:04.836248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:04.836562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:04.838022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:04.858212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 614/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:54:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:04.862879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:04.976463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bafd6f-7db5-4755-86ff-803de4f270c8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:05.012516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:05.013134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:05.013494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:05.014293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:05.083476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:05.091591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:05.093077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:05.205483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 627/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:54:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 19:54:05.211328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:05.242671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:05.323211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b36b6-0d01-498e-bba4-f471f317007d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:05.363716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:05.364712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:05.365123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:05.365464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:05.378109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:05.379866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:05.396685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:05.397806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:05.398913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:05.398913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:05.398913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:05.398913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:05.398913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 615/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:05.405498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:05.519641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:05.526456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfbeaa-0c35-4bec-9545-500f3ac874de None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:05.567926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:05.569197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:05.569772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:05.570379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:05.571925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:05.572626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:05.574730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:05.597096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 628/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:05.603156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:05.694735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:05.718959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267864c-0a0a-4eed-ae9e-d870d7918603 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:05.758058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:05.758812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:05.759184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:05.759556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:05.767767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:05.769454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:54:05.781819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:05.782925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:05.783781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 616/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:05.789335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:05.904982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc5e89-d2d1-4de5-a835-33346bd66aef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:05.945625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:05.946232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:05.946527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:05.946785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:05.947525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:05.947836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:05.949252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b911-5bdf-4e51-81a9-da90a0a477d7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:05.963734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 629/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:54:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:05.971381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:06.078097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c23d4-6af2-46fb-989f-37d339a7d9c0 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:06.116273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:06.116891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:06.117169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:06.117468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:06.118477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] RBAC: Adding query filter params (role.id=4a74a82a0c4e47ea8120a7f749ff9bd6, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:06.118825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:06.120591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609ca7b-4a6f-42dc-bae8-26cb3d2c4ff3 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:06.128643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 617/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:54:05 2022] GET /identity/v3/role_assignments?user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=4a74a82a0c4e47ea8120a7f749ff9bd6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:08.393071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22850d2-20b0-45ae-b995-23c550c1b75b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:08.393666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22850d2-20b0-45ae-b995-23c550c1b75b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:08.393666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22850d2-20b0-45ae-b995-23c550c1b75b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:08.395203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 630/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:08.400764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:08.401318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:08.401431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:08.408704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:08.422804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:08.424003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:08.513655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 618/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:08.539205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22850d2-20b0-45ae-b995-23c550c1b75b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:08.560828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:08.658159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22850d2-20b0-45ae-b995-23c550c1b75b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:08.700938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:08.701889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:08.702373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:08.702834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:08.717433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:54:08.723510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:08.724628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:08.725704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:08.731464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 631/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:08.733038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:08.840336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0056a1-d113-4f0c-af5e-18a198440801 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:08.875565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:08.882014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:08.882647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:08.883001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:08.883277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:08.883989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:08.884292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:08.885704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:08.894776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 619/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:54:08.900472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:08.986543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:09.011877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c2f2f-f6b8-4d8a-a03e-87b3e5b87b12 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:09.055011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:09.055663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:09.055947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:09.056260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:09.067526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:09.068994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:09.085127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:09.086360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:09.087308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:09.087308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:09.087308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:09.087308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:09.087308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 632/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:09.093045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:09.207072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f7ca-a5bf-4bfc-a4ab-7e747b4f73e1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:09.243211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:09.243788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:09.244066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:09.244339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:09.245026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:09.245361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:09.246818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:09.262637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 620/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:54:09.268073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:09.379657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50604cd9-1dd0-407c-9fd0-e189d2c2fece None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:09.409754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:09.418683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:09.419451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:09.419803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:09.420088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:09.428490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:09.430262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:54:09.442888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:09.444078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:09.445023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 633/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:09.450200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:09.511313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:09.559247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368733b-2362-489e-a96c-e5b7af2259cb None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:09.600246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:09.601167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:09.601530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:09.601853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:09.602823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:09.603214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:09.605827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:09.629297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 621/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:54:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:09.631451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:09.741703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d89703-592d-4aec-86b3-5869b3e371d8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:09.778582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:09.779671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:09.779950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:09.780223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:09.842538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:09.856534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:09.858703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:09.970258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 634/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:54:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:54:09.976674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:10.085728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc68cd8-0974-4db7-8f8e-12602f287b99 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:10.100488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:10.124581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:10.125308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:10.125600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:10.125881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:10.138490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:10.140283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:10.157082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:10.158305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:10.159222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:10.159222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:10.159222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:10.159222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:10.159222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 622/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:54:10.164197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:10.254314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:10.268223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e2c0-b47c-438f-beef-906c66e1ea76 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:10.306239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:10.306855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:10.307176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:10.307452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:10.308244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:10.308566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:10.310731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:10.324714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 635/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:10.331191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:10.448401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0a31-46a4-4c46-bd10-e296cf0dab72 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:10.492768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:10.493688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:10.494101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:10.494413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:10.502331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:10.503763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:54:10.515528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:10.516603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:10.517567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 623/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:10.522811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:10.640517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5baf0-7587-4b58-aa20-d061646ab214 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:10.676208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:10.676829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:10.677117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:10.677434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:10.678187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:10.678517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:10.679941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b64e-000c-43a7-950a-94f7d182c8dd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:10.693781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 636/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:10.700105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:10.727990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:10.812752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970038-99bb-4468-b6d0-723fe369fd04 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:10.849158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:10.849814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:10.850097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:10.850377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:10.851165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:10.851478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:10.852906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46016c0-e6d3-4d9c-b7bc-315969a4f709 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:10.858642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 624/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:54:10 2022] GET /identity/v3/role_assignments?user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:12.880608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd535-5c00-4e00-b321-2d23b7e0a2bf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:12.881126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd535-5c00-4e00-b321-2d23b7e0a2bf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:12.881126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd535-5c00-4e00-b321-2d23b7e0a2bf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:12.882538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 637/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:12.887684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:12.888145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:12.888280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:12.906281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:12.907468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:12.972240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 625/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:12.994678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cd535-5c00-4e00-b321-2d23b7e0a2bf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.008139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.096015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cd535-5c00-4e00-b321-2d23b7e0a2bf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.128421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.129050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.129363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.129643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.139383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:54:13.144193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:13.145305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:13.146494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 638/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:13.151301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.170074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.248306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4b84b-c0b0-43ef-ad5c-565fdec64349 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.281080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.281723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.282013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.282289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.283000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:13.283308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:13.284671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:13.292724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 626/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:13.298414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.362963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.395112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9293ca-0c0c-4255-9ee1-febdc42263f7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.427715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.428345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.428627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.428904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.439029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:13.440457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:13.454501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:13.455512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:13.456449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:13.456449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:13.456449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:13.456449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:13.456449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 639/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:13.461299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.539525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.559798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca442d-29d8-4193-9228-326ed53a468d None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.597521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.598151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.598436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.598724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.599418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:13.599759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:13.601098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:13.615346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 627/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:13.621883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.720122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeef37-1d33-4bde-9a15-f213c996d1b3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.739122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.753050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.753696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.753975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.754247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.761390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:13.762810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:54:13.774088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:13.775169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:13.776307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 640/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:13.781591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:13.878726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984ae7-7d89-4d38-8eed-f4debbc0207f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:13.913172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:13.913819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:13.914096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:13.914369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:13.915152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:13.915457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:13.916867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:13.925276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:13.933866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 628/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:13.939957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:14.036640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5afbc9-fd5e-460c-9214-12fe0b869839 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:14.068576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:14.069200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:14.069519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:14.069796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:14.080442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:14.081909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:14.095606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:14.096646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:14.097818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:14.097818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:14.097818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:14.097818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:14.097818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 641/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:14.102309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:14.198635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67c88e-3d33-4384-81f7-0b401e165392 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:14.231044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:14.232168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:14.232453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:14.232730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:14.233450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:14.233759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:14.235110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:14.246013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 629/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 19:54:14.252341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:14.282924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:14.350906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf8115-ff83-4742-b5ba-b923c0a0e2c9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:14.383007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:14.383640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:14.383927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:14.384208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:14.391178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:14.392626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:54:14.404310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:14.405365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:14.406296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 642/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:14.411607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:14.468421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:14.508552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4343-4cad-4d85-b9c8-f2b0fc6334a2 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:14.541503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:14.542115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:14.542400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:14.542678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:14.543422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:14.543732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:14.545729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ea37-ac91-492b-b199-c98c19989147 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:14.557868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 630/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:14.564915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:14.656118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:14.664842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64df4ca-1a95-47de-89c6-c4cf2734a774 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:14.697400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:14.698067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:14.698353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:14.698632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] PATH_INFO: `/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/845ce3ae6fd44a66b9fbe5a9c12e7eac/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:14.700569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f7c0a70ad94b019fd063c947ad7486, user_id=845ce3ae6fd44a66b9fbe5a9c12e7eac, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:14.702036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090888d-6686-4d43-a05a-5c8e518bf015 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:14.714800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 643/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 19:54:14 2022] PUT /identity/v3/projects/43f7c0a70ad94b019fd063c947ad7486/users/845ce3ae6fd44a66b9fbe5a9c12e7eac/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 19:54:16.708335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094062e-665d-4d12-90df-0da64bfdcefe None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:16.708859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094062e-665d-4d12-90df-0da64bfdcefe None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:16.708951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094062e-665d-4d12-90df-0da64bfdcefe None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:16.710407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 631/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:16.715547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:16.715939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:16.716658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:16.734352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:16.735535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:16.799593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 644/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:16.823160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094062e-665d-4d12-90df-0da64bfdcefe None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:16.923503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094062e-665d-4d12-90df-0da64bfdcefe None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:16.942057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:16.959063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:16.959636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:16.959916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:16.960188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:16.970037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 19:54:16.974895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:16.976085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:16.976914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 632/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 19:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:16.982121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.060240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:17.079101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c7d3-6268-4532-92f5-90ca2a0b3c58 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.111417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.112029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.112314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.112592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.113328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:17.113640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.114999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:17.123377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 645/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 19:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:17.129064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.225290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed16-5bde-4c92-b550-e505a1f09f10 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.258259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.258884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.259166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.259443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.269084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.270550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:17.285655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:17.286716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:17.287816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:17.287816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:17.287816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:17.287816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:17.287816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 633/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:17.292343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.388748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5653-66b4-4a50-9f06-7b68a868c6e5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.421116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.421756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.422042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.422322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.423008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:17.423321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.424677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:17.435993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 646/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:17.443665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.474472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:17.541586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1acd-00f1-46db-ad49-cae18cdb02fe None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.577352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.578137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.578395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.578772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.587223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.589303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 19:54:17.601291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:17.602436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:17.603818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 634/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 19:54:17.608852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.612582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:17.704836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732f28a-3ccb-4775-8c3e-1d1546db5e4d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.738063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.738668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.738946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.739216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.739994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:17.740299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.741743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:17.757941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 647/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 19:54:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:17.763768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:17.852425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:17.862906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dedd0a-c452-4c48-a544-a33d8c80c85f None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:17.895950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:17.896573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:17.896858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:17.897135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:17.963351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:17.964799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.051936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:18.063088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 635/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 19:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 19:54:18.069019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:18.131016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:18.167937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4cfd5-de2b-443a-aeac-4f6a6f554ec1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:18.201088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:18.201750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:18.202033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:18.202308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:18.211996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:18.213473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 19:54:18.227442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:18.228461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:18.229600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 19:54:18.229600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 19:54:18.229600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 19:54:18.229600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:18.229600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 648/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:18.234781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:18.332540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f05bf1-3b2b-4358-a94b-e42e82e61c70 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:18.365806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:18.366410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:18.366695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:18.366969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:18.367646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:18.367946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:18.369402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.380293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 636/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 19:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:18.385951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:18.482041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd9e78-c2b6-4cf8-9fbe-732b197c4461 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:18.494940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:18.514353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:18.514984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:18.515268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:18.515546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:18.521891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:18.523311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 19:54:18.534800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:18.536089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 28 19:54:18.537423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 649/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 19:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:18.541968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:18.596592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:18.645710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785ae0e-d6e8-476e-8f25-56842b163890 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:18.679835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:18.680471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:18.680754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:18.681033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:18.681806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:18.682117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:18.683584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500244-1557-4adf-9c94-8bc7bc77f337 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.695182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 637/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 19:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:18.701840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:18.798148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b894f4-42ce-4436-9346-bfc873d92df0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:18.830349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:18.830945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:18.831230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:18.831505 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:18.832285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] RBAC: Adding query filter params (role.id=37946d08da58471c9678da91450dd183, scope.project.id=43f7c0a70ad94b019fd063c947ad7486, user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:18.832594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:18.834032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8732c-0f70-4da4-8794-452825107989 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:18.839571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 650/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 19:54:18 2022] GET /identity/v3/role_assignments?user.id=845ce3ae6fd44a66b9fbe5a9c12e7eac&scope.project.id=43f7c0a70ad94b019fd063c947ad7486&role.id=37946d08da58471c9678da91450dd183 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:20.833642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9334-5df1-4aa7-8b04-1404540a1d6a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:20.834170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9334-5df1-4aa7-8b04-1404540a1d6a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:20.834263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9334-5df1-4aa7-8b04-1404540a1d6a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:20.835575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 638/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:20.841234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:20.841631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:20.841848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:20.860137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:20.861354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:20.890768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:20.927925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 651/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:20.949184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9334-5df1-4aa7-8b04-1404540a1d6a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:21.056742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9334-5df1-4aa7-8b04-1404540a1d6a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:21.067029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:21.090241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:21.091447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:21.091732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:21.092010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:21.092813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:21.095408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:21.105545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:21.106685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:21.107528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 639/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:54:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:21.112945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:21.208465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f76b-f612-40c5-82e0-5a7fc73d93cb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:21.240759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:21.241392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:21.241672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:21.241944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:21.242608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:21.242918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:21.244416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599ffd-2f7a-4596-844e-756b1e79ddc2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:21.249152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 652/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 19:54:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:21.254748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:21.354471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c8ae-1d10-4042-8ce5-1352a30a21b1 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:21.389456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:21.390064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:21.390345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:21.390619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] PATH_INFO: `/v3/services` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:21.391293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:21.391595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:21.392955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9953d0b-395f-47b7-a920-3d94af8bba73 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:21.397217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 640/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 19:54:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:23.385030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ad8d-c546-446d-ba42-d3b9a33990cf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:23.385603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ad8d-c546-446d-ba42-d3b9a33990cf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:23.385603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05ad8d-c546-446d-ba42-d3b9a33990cf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:23.386970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 653/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:23.392273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5d9a-9afd-4e31-b13a-f427aeb1ebae None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:23.392702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5d9a-9afd-4e31-b13a-f427aeb1ebae None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:23.392835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5d9a-9afd-4e31-b13a-f427aeb1ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:23.412982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-12fb5d9a-9afd-4e31-b13a-f427aeb1ebae None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:23.414313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-12fb5d9a-9afd-4e31-b13a-f427aeb1ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:23.443721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:23.479613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 641/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:23.502354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ad8d-c546-446d-ba42-d3b9a33990cf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:23.533188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:23.606153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05ad8d-c546-446d-ba42-d3b9a33990cf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:23.643204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:23.643752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:23.644035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:23.644309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:23.645005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:23.646414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958df17-bcc6-4f9b-8aa6-a0fb97dc719f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:23.660148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 654/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 19:54:23 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:54:25.640260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f579-906e-4923-87b8-fa2976c929a5 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:25.640860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f579-906e-4923-87b8-fa2976c929a5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:25.640860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f579-906e-4923-87b8-fa2976c929a5 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:25.642265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 642/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:25.647196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:25.647643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:25.647750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:25.666625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:25.667819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:25.739176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 655/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 19:54:25.761451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21f579-906e-4923-87b8-fa2976c929a5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:25.861991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21f579-906e-4923-87b8-fa2976c929a5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:25.895829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:25.896406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:25.896689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:25.896964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:25.897622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:25.898984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:25.907554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:25.908910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:25.910065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 643/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:54:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:25.915184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:25.932969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:26.011963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1747fb-ddfc-4687-a2d3-1a9ae29d7545 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:26.045510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:26.046119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:26.046410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:26.046689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:26.047362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:26.047667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:26.049021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:26.054018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 656/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 19:54:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:26.059970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:26.091136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:26.157493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45725a-f8e9-4e17-b44f-86a9348ddf2a None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:26.190039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:26.190640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:26.190919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:26.191192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:26.191943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] RBAC: Adding query filter params (interface=public, service_id=a938f0ae815b4ecf931e5135a43f3654, region_id=RegionOne) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:26.192254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:26.193630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a584-73ab-4c75-b628-bdc7c369a990 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:26.198541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 644/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 19:54:26 2022] GET /identity/v3/endpoints?service_id=a938f0ae815b4ecf931e5135a43f3654&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:26.204650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:26.283314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:26.301667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd3bcc-764e-4841-9469-151269763d7a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:26.334530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:26.335134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:26.335419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:26.335698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:26.336341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:26.337717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195e65-c7e3-44cd-9f14-3bb325aed16f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:26.344356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 657/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 19:54:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:54:28.362080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f345-1e6e-4ac8-a1ce-52ff31b5dd4d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:28.362612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f345-1e6e-4ac8-a1ce-52ff31b5dd4d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:28.362715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483f345-1e6e-4ac8-a1ce-52ff31b5dd4d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:28.364003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 645/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:54:28.368938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:28.369376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:28.369531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:28.389215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:54:28.390442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:54:28.454490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 658/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:54:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 19:54:28.476610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483f345-1e6e-4ac8-a1ce-52ff31b5dd4d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:28.570563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:28.578802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483f345-1e6e-4ac8-a1ce-52ff31b5dd4d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:28.615117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:28.616083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:28.616398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:28.616608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:28.617289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:28.618895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 19:54:28.628360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 19:54:28.629612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application with Lock( Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self._enter() Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application return self.creator() Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application created_value = creator( Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: ERROR keystone.server.flask.application Jul 28 19:54:28.630668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 646/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 19:54:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 19:54:28.635753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:28.710389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:28.733510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d0529-2ec8-48ab-a237-f9fdf02f6bf8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:28.766547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:28.767150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:28.767431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:28.767703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:28.768366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 19:54:28.768667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:28.770038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b7795-2556-438a-9715-6dfc7bb8543f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:28.775068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 659/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 19:54:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 19:54:28.781538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:54:28.884499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fbfbe-9982-4cfa-b8a9-b1a7f16e9629 None admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:54:28.917503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:54:28.918119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:54:28.918404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:54:28.918683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:54:28.919391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:54:28.920754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b95fe7-eeef-46a0-bf97-d4277689c8e5 None admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:54:28.940326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 647/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 19:54:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 19:54:38.772044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=30 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:54:38.936648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:31.208354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16d97-e4b0-4001-9eb3-e13eed88a1d4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:31.209013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16d97-e4b0-4001-9eb3-e13eed88a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:31.209013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16d97-e4b0-4001-9eb3-e13eed88a1d4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:31.214102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 660/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:31.215397 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540974b-552c-441f-a69f-d2190b56e18c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:31.215843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540974b-552c-441f-a69f-d2190b56e18c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:31.216045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540974b-552c-441f-a69f-d2190b56e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:31.301030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8540974b-552c-441f-a69f-d2190b56e18c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:31.303004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8540974b-552c-441f-a69f-d2190b56e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:31.421017 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 648/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:55:31.474611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:31.475972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:31.477958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:31.479640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 661/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 19:55:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:31.486481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a186e-c9a2-4722-81f8-049c72412af8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:31.486790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a186e-c9a2-4722-81f8-049c72412af8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:31.487055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a186e-c9a2-4722-81f8-049c72412af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:31.589558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-069a186e-c9a2-4722-81f8-049c72412af8 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:31.590939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-069a186e-c9a2-4722-81f8-049c72412af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:31.634669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:31.697688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 649/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 19:55:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:55:31.706561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:31.708308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:31.828895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1a083-6e94-49ee-9505-dd805cd3f924 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:31.911789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:31.912422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:31.912706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:31.912982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:31.914639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:31.971028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:32.029556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:32.030997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aa47-c886-4a63-88a4-5aba46d0bca5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:32.050856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 662/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:34.375781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:34.376367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:34.376367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:34.377742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 650/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:34.383008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5b40-6726-4d56-b57d-1fa6ad349738 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:34.383573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5b40-6726-4d56-b57d-1fa6ad349738 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:34.383573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5b40-6726-4d56-b57d-1fa6ad349738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:34.476125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1b2e5b40-6726-4d56-b57d-1fa6ad349738 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:34.478843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1b2e5b40-6726-4d56-b57d-1fa6ad349738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:34.599731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 663/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:34.639140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:34.640773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:34.754843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec279fe-9b37-4168-a658-9f9f19a6e097 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:34.835042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:34.839406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:34.840045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:34.840327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:34.840602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:34.842394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:34.957826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:34.959459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4315-a59a-4f03-be62-0d2a9a472fa8 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:34.979986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 651/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:37.437027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:37.437565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:37.437565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:37.439049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 664/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:37.444251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5279fe-e3b0-4aa4-8769-bbc694e9f0fa None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:37.444661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5279fe-e3b0-4aa4-8769-bbc694e9f0fa None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:37.444941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5279fe-e3b0-4aa4-8769-bbc694e9f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:37.513089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-dc5279fe-e3b0-4aa4-8769-bbc694e9f0fa None None] MFA Rules not processed for user `3ffbe36b8a094832848477282e31103c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:37.514348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dc5279fe-e3b0-4aa4-8769-bbc694e9f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:37.569449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:37.614976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 652/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:37.662010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:37.663543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:37.673322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:37.776414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760342a-c9d1-42fc-96b2-e95058857457 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:37.870522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:37.871151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:37.871435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:37.871743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:37.873400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:37.942425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:38.002643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:38.004896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03cbf4-127a-47ce-8af7-657c45f4ab0d service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:38.031293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 665/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:40.880102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:40.880659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:40.880659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:40.882073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 653/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:40.887271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4567f2-65bf-4875-8612-f287f7efbbc6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:40.887702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4567f2-65bf-4875-8612-f287f7efbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:40.887836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4567f2-65bf-4875-8612-f287f7efbbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:40.952338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2f4567f2-65bf-4875-8612-f287f7efbbc6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:40.953576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f4567f2-65bf-4875-8612-f287f7efbbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:41.046691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 666/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:41.085431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:41.087009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:41.189564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268c54b-9962-4961-a8c7-a0dca48fbf3e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:41.261255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:41.261897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:41.262179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:41.262455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:41.264059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:41.271364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:41.371042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:41.372472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3def1-54ee-4c86-a5f6-3647648ce290 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:41.390765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 654/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:44.065214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b34c-78f1-4b5a-9404-33d15479677c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:44.065762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b34c-78f1-4b5a-9404-33d15479677c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:44.065851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b34c-78f1-4b5a-9404-33d15479677c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:44.067208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 667/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:44.072474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd79487-a023-40ad-8bb2-e231529cb706 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:44.072897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd79487-a023-40ad-8bb2-e231529cb706 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:44.073029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd79487-a023-40ad-8bb2-e231529cb706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:44.139141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8bd79487-a023-40ad-8bb2-e231529cb706 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:44.140269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8bd79487-a023-40ad-8bb2-e231529cb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:44.200169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:44.246922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 655/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:44.299814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:44.300121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:44.300371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:44.301824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 668/1323] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 19:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:44.308426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd06fe-54f8-4358-ac32-56346d2ea030 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:44.308810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd06fe-54f8-4358-ac32-56346d2ea030 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:44.309161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd06fe-54f8-4358-ac32-56346d2ea030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:44.391677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d1dd06fe-54f8-4358-ac32-56346d2ea030 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:44.392801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d1dd06fe-54f8-4358-ac32-56346d2ea030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:44.469347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 656/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 19:55:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:44.478516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:44.480052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:44.499219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:44.584851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc781a7-0fee-4fb7-92c4-df266c016e44 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:44.657987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:44.658507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:44.658792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:44.659340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:44.660964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:44.731755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:44.770847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:44.772301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652745ad-e017-4f4e-b58f-3e0cc5cfa871 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:44.790157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 669/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 19:55:47.064522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:47.065060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:47.065060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:47.066667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 657/1326] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:47.072382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c770b-ec80-4044-82a2-dd27f779b780 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:47.072912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c770b-ec80-4044-82a2-dd27f779b780 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:47.073003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c770b-ec80-4044-82a2-dd27f779b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:47.140477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7f1c770b-ec80-4044-82a2-dd27f779b780 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:47.141653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7f1c770b-ec80-4044-82a2-dd27f779b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:47.237601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 670/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:55:47.275325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:47.276859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:47.338332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:47.381832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2f829-10ec-4d1e-8347-c34838555181 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:47.457798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:47.458350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:47.458643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:47.458918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:47.460549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:47.569783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:47.572749 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:47.574837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d595cf-1929-4aeb-a89b-8a75e61bdebb service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:47.593996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 658/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:49.633526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:49.634051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:49.634143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:49.635432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 671/1329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:49.640614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323e86b-15d3-4d3a-a052-30250c41a62d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:49.641005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323e86b-15d3-4d3a-a052-30250c41a62d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:49.641173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323e86b-15d3-4d3a-a052-30250c41a62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:49.709496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2323e86b-15d3-4d3a-a052-30250c41a62d None None] MFA Rules not processed for user `3ffbe36b8a094832848477282e31103c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:49.710646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2323e86b-15d3-4d3a-a052-30250c41a62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:49.810792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 659/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:49.853598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:49.855137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:49.900140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:49.981288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445a6a-c556-4dbe-8328-c9424779734b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:50.056270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:50.056890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:50.057174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:50.057480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:50.059103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:50.142242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:50.176895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:50.178394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263700b-d1c4-4296-bde7-0f50174535ce service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:50.196982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 672/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:52.437009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:52.437584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:52.437695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:52.438982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 660/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:52.444039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b12f81-d0b2-4439-be62-6c3cda0ac716 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:52.444414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b12f81-d0b2-4439-be62-6c3cda0ac716 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:52.444597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b12f81-d0b2-4439-be62-6c3cda0ac716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:52.511097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-88b12f81-d0b2-4439-be62-6c3cda0ac716 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:52.512313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-88b12f81-d0b2-4439-be62-6c3cda0ac716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:52.606654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 673/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:55:52.642579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:52.644086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:52.712631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:52.747244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f898f-e254-4cd6-bc9d-a81fc4b12a06 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:52.818942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:52.819620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:52.819898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:52.820166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:52.821834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:52.930265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:52.931736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd15cae-7965-46ff-bbcd-8abce1e69cc3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:52.941823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:52.951027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 661/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:55.036980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:55.037565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:55.037565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:55.038940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 674/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:55.044141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02b7d-e0b6-44f6-a757-96c864e2418d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:55.044520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02b7d-e0b6-44f6-a757-96c864e2418d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:55.044685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02b7d-e0b6-44f6-a757-96c864e2418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:55.110471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-dcf02b7d-e0b6-44f6-a757-96c864e2418d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:55.111662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dcf02b7d-e0b6-44f6-a757-96c864e2418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:55.208158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 662/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:55:55.255987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:55.257696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:55.298650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:55.361333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdb7d8-7c26-417a-a552-b1232479a7eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:55.434544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:55.435099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:55.435384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:55.435664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:55.437304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:55.520294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:55.547397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:55.548825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbffdbd-42d6-4767-96f0-0fbd3097b2cd service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:55.567187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 675/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:55:58.174790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:58.175351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:58.175351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:58.176660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 663/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:55:58.182385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ab3a-aba2-40b2-88a1-d5b71233ee0c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:58.182831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ab3a-aba2-40b2-88a1-d5b71233ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:58.182938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0ab3a-aba2-40b2-88a1-d5b71233ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:58.248079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d4f0ab3a-aba2-40b2-88a1-d5b71233ee0c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:55:58.249310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4f0ab3a-aba2-40b2-88a1-d5b71233ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:58.345603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 676/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:55:58.382210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:55:58.384376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:58.458636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:55:58.486411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970779a-3d6c-4a21-9653-f35006a2f2fc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:55:58.560688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:55:58.561350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:55:58.561629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:55:58.561895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:55:58.563485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:55:58.674791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:55:58.676235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b204-0cb2-4a6e-b6e8-948d22017fdf service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:55:58.694918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 664/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:55:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:02.720487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:02.721004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:02.721004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:02.722529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 677/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:02.727467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69abb6f-2861-4ef0-8187-fd48d7cdc2bf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:02.727880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69abb6f-2861-4ef0-8187-fd48d7cdc2bf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:02.728021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69abb6f-2861-4ef0-8187-fd48d7cdc2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:02.733563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:02.795472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e69abb6f-2861-4ef0-8187-fd48d7cdc2bf None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:02.796680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e69abb6f-2861-4ef0-8187-fd48d7cdc2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:02.897442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 665/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:02.936965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:02.938547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:02.990472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:03.048097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec41ca4-a2c3-47d1-a9d5-8fa5d2cca0f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:03.121583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:03.122211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:03.122493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:03.122766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:03.124384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:03.220856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:03.237819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:03.239367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eebe6-91b8-45a3-b535-d44ab5df5aca service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:03.257341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 678/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:05.887856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:05.888313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:05.888409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:05.889774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 666/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:05.895440 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30373b2-d2cc-466e-aeb2-e0394d3e9644 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:05.895950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30373b2-d2cc-466e-aeb2-e0394d3e9644 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:05.896055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30373b2-d2cc-466e-aeb2-e0394d3e9644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:05.972645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d30373b2-d2cc-466e-aeb2-e0394d3e9644 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:05.973938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d30373b2-d2cc-466e-aeb2-e0394d3e9644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:06.075693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 679/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:06.113230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:06.114793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:06.202110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:06.219416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3abd8-350d-4392-a607-f20818ad000e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:06.295665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:06.296206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:06.296490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:06.296767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:06.298433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:06.406452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:06.407895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824f03-f744-476f-8813-a39f8aa4738a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:06.426382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 667/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:10.359987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:10.360578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:10.360578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:10.362087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 680/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:10.367154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cc0f-db5c-4055-a60a-db63a42ae012 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:10.367612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cc0f-db5c-4055-a60a-db63a42ae012 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:10.367769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cc0f-db5c-4055-a60a-db63a42ae012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:10.384801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:10.436716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2701cc0f-db5c-4055-a60a-db63a42ae012 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:10.437976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2701cc0f-db5c-4055-a60a-db63a42ae012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:10.538508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 668/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:10.578290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:10.579829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:10.640666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:10.709594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9fce-dc9d-48f9-a7f5-24d00a22981d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:10.793260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:10.794016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:10.794307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:10.794581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:10.796235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:10.907733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:10.911557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:10.913609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221118e9-85be-4c2a-938b-679ca2c8be0f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:10.933793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 681/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:15.823697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dec06-4e83-4916-a28f-e7e57d1a71a0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:15.824226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dec06-4e83-4916-a28f-e7e57d1a71a0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:15.824310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dec06-4e83-4916-a28f-e7e57d1a71a0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:15.826207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 669/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 19:56:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:15.832833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcca40-a12a-4b7a-8eff-3f5e37580065 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:15.836173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcca40-a12a-4b7a-8eff-3f5e37580065 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:15.839477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcca40-a12a-4b7a-8eff-3f5e37580065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:15.957248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9abcca40-a12a-4b7a-8eff-3f5e37580065 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:15.960930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9abcca40-a12a-4b7a-8eff-3f5e37580065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:16.138201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 682/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:20.374874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2113-0e37-40df-9a89-a6ce37ca05ea None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:20.375809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2113-0e37-40df-9a89-a6ce37ca05ea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:20.376169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2113-0e37-40df-9a89-a6ce37ca05ea None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:20.377947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 670/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 19:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:20.383066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7e35-0a8f-4cac-93d3-d5e8df3fdaf7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:20.383996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7e35-0a8f-4cac-93d3-d5e8df3fdaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:20.384222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7e35-0a8f-4cac-93d3-d5e8df3fdaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:20.443811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:20.469539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a30e7e35-0a8f-4cac-93d3-d5e8df3fdaf7 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:20.470756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a30e7e35-0a8f-4cac-93d3-d5e8df3fdaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:20.536549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=59 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:20.589992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 683/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 19:56:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:21.743265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410360-2abc-451c-a9d0-6374fdae2486 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:21.743763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410360-2abc-451c-a9d0-6374fdae2486 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:21.743763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410360-2abc-451c-a9d0-6374fdae2486 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:21.745107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 671/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 19:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:21.750046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179be4-b1b3-420e-aba9-5d4872f26258 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:21.750498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179be4-b1b3-420e-aba9-5d4872f26258 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:21.750720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179be4-b1b3-420e-aba9-5d4872f26258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:21.828104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b2179be4-b1b3-420e-aba9-5d4872f26258 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:21.829344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b2179be4-b1b3-420e-aba9-5d4872f26258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:21.871828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:21.937456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 684/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 19:56:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:25.298556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c019b0-9f83-4bdf-875a-7a55e5c72d1f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:25.299068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c019b0-9f83-4bdf-875a-7a55e5c72d1f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:25.299150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c019b0-9f83-4bdf-875a-7a55e5c72d1f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:25.306493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 672/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:25.307066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd137d-634c-4c93-8b5a-d996d7412398 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:25.307566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd137d-634c-4c93-8b5a-d996d7412398 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:25.307651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd137d-634c-4c93-8b5a-d996d7412398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:25.390103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-51bd137d-634c-4c93-8b5a-d996d7412398 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:25.391320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-51bd137d-634c-4c93-8b5a-d996d7412398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:25.494616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 685/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:25.548933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:25.549221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:25.549712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:25.551445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 673/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 19:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:25.560512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136094d-98fb-4a4a-b868-ba7fdee22a3d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:25.561003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136094d-98fb-4a4a-b868-ba7fdee22a3d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:25.561471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136094d-98fb-4a4a-b868-ba7fdee22a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:25.578362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:25.642374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3136094d-98fb-4a4a-b868-ba7fdee22a3d None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:25.643828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3136094d-98fb-4a4a-b868-ba7fdee22a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:25.765324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 686/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:25.773032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:25.774609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:25.937044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb3a7-3bed-4d0d-94c3-314b3bf210c1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:26.013001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:26.055910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:26.056454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:26.056740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:26.057021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:26.058657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:26.155387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:26.157208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9cf8-4bed-4041-bd84-43126468acd9 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:26.191504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 674/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:28.446949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:28.447518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:28.447518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:28.452430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 687/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:28.454099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b693-76d2-4863-939f-640ed3aaf84a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:28.454514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b693-76d2-4863-939f-640ed3aaf84a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:28.454726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134b693-76d2-4863-939f-640ed3aaf84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:28.526912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e134b693-76d2-4863-939f-640ed3aaf84a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:28.528415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e134b693-76d2-4863-939f-640ed3aaf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:28.574238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:28.641958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 675/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:28.684168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:28.686234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:28.761427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:28.856258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762e0d-aff3-4dd6-881d-98fa44981fd0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:28.990332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:28.990894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:28.991175 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:28.991449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:28.993189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:29.017925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:29.095774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:29.097441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a8ff6-ddde-41eb-a7d1-5d264db61c09 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:29.116491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 688/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:31.492628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef444-07f6-43bc-b9df-58606cf14769 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:31.493726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef444-07f6-43bc-b9df-58606cf14769 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:31.493726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef444-07f6-43bc-b9df-58606cf14769 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:31.495188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 676/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:31.500358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a70e2-c1fe-490a-a847-42e316eefd93 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:31.500825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a70e2-c1fe-490a-a847-42e316eefd93 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:31.500920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a70e2-c1fe-490a-a847-42e316eefd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:31.576387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e46a70e2-c1fe-490a-a847-42e316eefd93 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:31.577809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e46a70e2-c1fe-490a-a847-42e316eefd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:31.696360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:31.708480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 689/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:31.746900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:31.747252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:31.747628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:31.749398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 677/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 19:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:31.754956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39c01-2b22-4db4-94ee-a2f608267735 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:31.755327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39c01-2b22-4db4-94ee-a2f608267735 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:31.755685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39c01-2b22-4db4-94ee-a2f608267735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:31.849651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-55b39c01-2b22-4db4-94ee-a2f608267735 None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:31.850871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-55b39c01-2b22-4db4-94ee-a2f608267735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:31.983933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 690/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 19:56:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:31.992182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:31.994298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:32.168392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eca05-1856-40df-aa2f-ae1a1d34cded None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:32.190402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:32.290190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:32.290814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:32.291093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:32.291367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:32.292971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:32.386806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:32.388995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588ec6-3def-419d-b0e7-edb8533275ff service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:32.409605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 678/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:33.388241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e83c-5925-42b9-9449-1ae63ebfe566 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:33.388759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e83c-5925-42b9-9449-1ae63ebfe566 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:33.388841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e83c-5925-42b9-9449-1ae63ebfe566 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:33.390375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 691/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:33.395373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c96ca5-bd5e-44bd-be88-a9cdd50d7e60 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:33.395768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c96ca5-bd5e-44bd-be88-a9cdd50d7e60 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:33.395952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c96ca5-bd5e-44bd-be88-a9cdd50d7e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:33.429341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:33.468468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c4c96ca5-bd5e-44bd-be88-a9cdd50d7e60 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:33.469625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4c96ca5-bd5e-44bd-be88-a9cdd50d7e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:33.568736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 679/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:33.919410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:33.919410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:33.919410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:33.922291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 692/1371] 10.222.0.42 () {54 vars in 964 bytes} [Thu Jul 28 19:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:33.925516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484bf4f-7c3d-47ed-9d45-b65be51207bc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:33.925812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484bf4f-7c3d-47ed-9d45-b65be51207bc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:33.926094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484bf4f-7c3d-47ed-9d45-b65be51207bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:34.006545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0484bf4f-7c3d-47ed-9d45-b65be51207bc None None] MFA Rules not processed for user `10705bb480e94b7484e5a3a4983a7cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:34.007754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0484bf4f-7c3d-47ed-9d45-b65be51207bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:34.057623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:34.089416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 680/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Jul 28 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:56:34.096123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:34.097682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:34.151591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:34.209743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7e1e9-ecdb-4e4b-94ae-ab46e2c255eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:34.286368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:34.287110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:34.287465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:34.287813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:34.290104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:34.389619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:34.405065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:34.406514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a1b4f-b73e-47cc-9ae0-111a74f93133 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:34.426801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 693/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:34.513231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:34.513700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:34.513988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:34.515708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 681/1374] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:34.520610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90d09-fd2e-4562-b053-b0d6bfa04063 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:34.520857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90d09-fd2e-4562-b053-b0d6bfa04063 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:34.521123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee90d09-fd2e-4562-b053-b0d6bfa04063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:34.589787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3ee90d09-fd2e-4562-b053-b0d6bfa04063 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:34.590969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3ee90d09-fd2e-4562-b053-b0d6bfa04063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:34.709711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 694/1375] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:34.754966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:34.756448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:34.941457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf5f25-fc1e-4c68-8cae-9eebf25fedd7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:34.992291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:35.053336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:35.054044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:35.054390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:35.054733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:35.056408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:35.145542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:35.147579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabfc94-2295-4072-a23a-a9de258d46f9 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:35.168961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 682/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:37.235838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:37.236296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:37.236533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:37.238048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 695/1377] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:37.243729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b02ab-0510-4a9e-8a28-08f206412f0d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:37.244139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b02ab-0510-4a9e-8a28-08f206412f0d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:37.244412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b02ab-0510-4a9e-8a28-08f206412f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:37.311446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0f8b02ab-0510-4a9e-8a28-08f206412f0d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:37.312655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0f8b02ab-0510-4a9e-8a28-08f206412f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:37.319737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:37.431724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 683/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:37.480365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:37.483117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:37.568951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:37.654860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73fc2-b83d-4a07-be0a-8c35f9ea8bbc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:37.773688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:37.774323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:37.774607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:37.774887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:37.776523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:37.796205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:37.877063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:37.884524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4ee6-a722-47d1-9705-24880fd452aa service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:37.911328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 696/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:39.988289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:39.988811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:39.988811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:39.990305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 684/1380] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:39.995864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c163-0da3-4514-93a6-e6ee469fdfa3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:39.996295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c163-0da3-4514-93a6-e6ee469fdfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:39.996478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c163-0da3-4514-93a6-e6ee469fdfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:40.082884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3008c163-0da3-4514-93a6-e6ee469fdfa3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:40.084098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3008c163-0da3-4514-93a6-e6ee469fdfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:40.181951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:40.189354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 697/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:40.233084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:40.234755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:40.394062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:40.405737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9fe8c-ec5c-4ff7-b346-9392dbf866bf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:40.531424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:40.532087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:40.532609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:40.532885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:40.534575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:40.629955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:40.631708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768fd14-f3aa-4398-a2ef-fcb5dabf8021 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:40.643041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:40.653328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 685/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:42.887494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:42.888037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:42.888037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:42.889425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 698/1383] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:42.894665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ad8d-5204-4152-a8d4-f8e6cef731d6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:42.895112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ad8d-5204-4152-a8d4-f8e6cef731d6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:42.895235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ad8d-5204-4152-a8d4-f8e6cef731d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:42.966022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7f05ad8d-5204-4152-a8d4-f8e6cef731d6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:42.967211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7f05ad8d-5204-4152-a8d4-f8e6cef731d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:43.068099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 686/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:43.128429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:43.130034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:43.292005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c244-1e50-4ac8-9e3a-6fba4c122503 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:43.363272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:43.438035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:43.439082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:43.439547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:43.440064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:43.443078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:43.543776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:43.545364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5ad9-220a-43a3-93aa-b3166ad441af service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:43.567402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 699/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:45.641372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:45.641924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:45.641924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:45.643270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 687/1386] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:45.648568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6142a4-203e-4618-88ee-da79fa7a3148 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:45.648980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6142a4-203e-4618-88ee-da79fa7a3148 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:45.649127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6142a4-203e-4618-88ee-da79fa7a3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:45.715333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0b6142a4-203e-4618-88ee-da79fa7a3148 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:45.716541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0b6142a4-203e-4618-88ee-da79fa7a3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:45.750077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:45.817451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 700/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:45.861327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:45.862860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:45.946775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:46.018145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb52dff-5914-4539-ac1e-9b25ce468918 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:46.140239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:46.140862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:46.141140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:46.141444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:46.143084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:46.191520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:46.249007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:46.251329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef679e62-e6ee-4234-988a-07185dd2195b service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:46.274916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 688/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:48.375540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:48.376059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:48.376153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:48.377690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 701/1389] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:48.382671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27128c53-1dd5-46fb-bd7e-86372f979d5c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:48.383085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27128c53-1dd5-46fb-bd7e-86372f979d5c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:48.383923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27128c53-1dd5-46fb-bd7e-86372f979d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:48.449739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-27128c53-1dd5-46fb-bd7e-86372f979d5c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:48.450942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-27128c53-1dd5-46fb-bd7e-86372f979d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:48.547346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 689/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:48.592053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:48.593813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:48.741565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958b25-20c4-45a5-a178-3924f29ccc83 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:48.757906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:48.854498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:48.855114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:48.855391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:48.859011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:48.859011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:48.946921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:48.948528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1e218-03fa-4f90-8c42-8835b1428322 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:48.967127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 702/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:49.555234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd500-0fa9-4ee6-8818-68a4d3a3d337 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:49.555771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd500-0fa9-4ee6-8818-68a4d3a3d337 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:49.555771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd500-0fa9-4ee6-8818-68a4d3a3d337 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:49.557471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 690/1392] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:49.562385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff122-4c3a-4626-a83d-37b79185f060 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:49.562775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff122-4c3a-4626-a83d-37b79185f060 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:49.562949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ff122-4c3a-4626-a83d-37b79185f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:49.590643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:49.631845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-505ff122-4c3a-4626-a83d-37b79185f060 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:49.633623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-505ff122-4c3a-4626-a83d-37b79185f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:49.729624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 703/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:49.784126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:49.784489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:49.784851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:49.786557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 691/1394] 10.222.0.42 () {54 vars in 966 bytes} [Thu Jul 28 19:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:49.791778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa42-d7bd-4423-a41a-c3f9c35ddd9b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:49.792071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa42-d7bd-4423-a41a-c3f9c35ddd9b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:49.792390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa42-d7bd-4423-a41a-c3f9c35ddd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:49.869388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-009ffa42-d7bd-4423-a41a-c3f9c35ddd9b None None] MFA Rules not processed for user `7e0f106ea63a4aa781ad03d7583abd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:49.870666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-009ffa42-d7bd-4423-a41a-c3f9c35ddd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:49.915124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:49.951135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 704/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Thu Jul 28 19:56:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:49.958734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:49.960355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:49.974097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:50.067259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d93c0-4946-48c1-b7cc-618c2ccd8f96 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:50.144028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:50.144571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:50.144854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:50.145181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:50.146896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:50.215052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:50.257088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:50.258664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb5de-6709-4094-855b-377486d3282b service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:50.277072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 692/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:51.010636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc035d5-f20d-4e06-b244-2498ae48e6ca None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.011109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc035d5-f20d-4e06-b244-2498ae48e6ca None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.011352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc035d5-f20d-4e06-b244-2498ae48e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.022210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497fb6-5e5c-415c-b30e-5534ac5784da None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.022679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497fb6-5e5c-415c-b30e-5534ac5784da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.022679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76497fb6-5e5c-415c-b30e-5534ac5784da None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.024676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 693/1397] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:56:51.029809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1223fd-deed-4e26-b929-8f8461fe247c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.030091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1223fd-deed-4e26-b929-8f8461fe247c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.030364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1223fd-deed-4e26-b929-8f8461fe247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.080336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0fc035d5-f20d-4e06-b244-2498ae48e6ca None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:51.081724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0fc035d5-f20d-4e06-b244-2498ae48e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.098680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4a1223fd-deed-4e26-b929-8f8461fe247c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:51.099880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4a1223fd-deed-4e26-b929-8f8461fe247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.169935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 705/1398] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:51.197964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 694/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:51.214223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.214513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.214792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.216154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 706/1400] 10.222.0.42 () {54 vars in 943 bytes} [Thu Jul 28 19:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:51.222550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.222950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.223230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.242840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:51.244352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.250236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:51.303214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] MFA Rules not processed for user `d44c1c7b81af41e5a016950b3aeb8589`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:51.304343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.308294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:51.395132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211ad4b-3082-48ba-a9a7-94d34bd9359d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:51.411553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 695/1401] 10.222.0.42 () {58 vars in 1040 bytes} [Thu Jul 28 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:51.421091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:51.431356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74286b-ab55-4c17-853f-9b268378fc12 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:51.502167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:51.509173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:51.509818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.510101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.510373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.511994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.529928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:51.538115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:51.538737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:51.539014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:51.539311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:51.540939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:51.608080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:51.609760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178548b-3e18-4336-bfe0-ea5175dc3281 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:51.629127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 707/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 19:56:51.634451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:51.636130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b814c-e568-41d8-ac95-393c001f97e7 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:51.645195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 696/1403] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 19:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 19:56:53.738651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:53.739247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:53.739247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:53.740718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 708/1404] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:53.746362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3694-f130-4786-8fde-15db83e1f859 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:53.746801 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3694-f130-4786-8fde-15db83e1f859 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:53.746904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3694-f130-4786-8fde-15db83e1f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:53.816734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-280f3694-f130-4786-8fde-15db83e1f859 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:53.818005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-280f3694-f130-4786-8fde-15db83e1f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:53.886814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:53.929816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 697/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:53.973817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:53.975340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:54.263500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:54.265979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824928-07e8-48e0-8353-ca76f54339ad None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:54.392731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:54.393545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:54.393914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:54.394247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:54.395998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:54.500950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:54.502759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8528e2-2754-4a3b-a631-61cfef9003d7 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:54.523920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 709/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:56:56.570094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:56.571191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:56.571191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:56.572485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 698/1407] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:56:56.578433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f100-4b18-452b-b5e5-16145c2a1184 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:56.579328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f100-4b18-452b-b5e5-16145c2a1184 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:56.579840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95f100-4b18-452b-b5e5-16145c2a1184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:56.584642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:56.671120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2d95f100-4b18-452b-b5e5-16145c2a1184 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:56:56.672372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d95f100-4b18-452b-b5e5-16145c2a1184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:56.826112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 710/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:56:56.870565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:56:56.872083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:57.047779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118179-0321-4c7b-8549-8acfd95dce2d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:56:57.098890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:57.183330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:56:57.183971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:56:57.184282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:56:57.184536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:56:57.186201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:56:57.297098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:56:57.299141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dda74-a67a-437d-842c-f23d9313614b service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:56:57.325325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 699/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 19:57:06.823795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=64 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:07.318957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=79 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:13.939580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c9d5-d444-45da-abdf-c167b3d6890a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:13.940126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c9d5-d444-45da-abdf-c167b3d6890a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:13.940126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c9d5-d444-45da-abdf-c167b3d6890a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:13.941545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 711/1410] 10.222.0.42 () {54 vars in 918 bytes} [Thu Jul 28 19:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 19:57:13.946726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15fbca-364d-448f-bdcf-ae350072f45f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:13.947142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15fbca-364d-448f-bdcf-ae350072f45f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:13.947280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15fbca-364d-448f-bdcf-ae350072f45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:14.022588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3a15fbca-364d-448f-bdcf-ae350072f45f None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:14.024304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3a15fbca-364d-448f-bdcf-ae350072f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:14.131838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 700/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 19:57:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:14.146694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b685-b723-4856-b0c7-72d15624c3fc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:14.146985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b685-b723-4856-b0c7-72d15624c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:14.147268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073b685-b723-4856-b0c7-72d15624c3fc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:14.148614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 712/1412] 10.222.0.42 () {54 vars in 918 bytes} [Thu Jul 28 19:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:14.153810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d566e-0030-4d2e-94dc-5ae1c5937eed None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:14.154102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d566e-0030-4d2e-94dc-5ae1c5937eed None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:14.154383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d566e-0030-4d2e-94dc-5ae1c5937eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:14.226216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:14.229098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3f8d566e-0030-4d2e-94dc-5ae1c5937eed None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:14.230925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3f8d566e-0030-4d2e-94dc-5ae1c5937eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:14.346753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 701/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:57:16.797785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:16.798298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:16.798298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:16.799616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:16.805015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a9b1-04a0-425b-b907-ec870d736abb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:16.805433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a9b1-04a0-425b-b907-ec870d736abb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:16.805612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a9b1-04a0-425b-b907-ec870d736abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:16.872301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2f32a9b1-04a0-425b-b907-ec870d736abb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:16.873544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2f32a9b1-04a0-425b-b907-ec870d736abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:16.928257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:16.970588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:17.014246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:17.015785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:17.162824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46a3da-ed92-4174-9ff4-03385afd3555 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:17.234236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:17.274761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:17.275398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:17.275696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:17.275973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:17.277623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:17.367362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:17.368944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ce382-9c7c-400c-a1ec-3ef447c52a3d service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:17.387046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 714/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:18.288777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:18.289324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:18.289324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:18.290672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:18.296154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849d964-5abc-4377-a58d-16add227e84d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:18.296617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849d964-5abc-4377-a58d-16add227e84d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:18.296719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849d964-5abc-4377-a58d-16add227e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:18.374601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8849d964-5abc-4377-a58d-16add227e84d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:18.375817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8849d964-5abc-4377-a58d-16add227e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:18.402687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:18.472409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:18.625848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:18.627388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:18.771949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42616ba8-72ef-4f6b-ba8a-f7298619a0b0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:18.812186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:18.885709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:18.886337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:18.886621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:18.886901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:18.888528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:18.976758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:18.978406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451ffde-1100-4e30-a0d7-861ac24ded1d service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:18.997293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 704/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:19.883595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:19.884114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:19.884240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:19.885631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:19.890572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4140d5-33f8-4993-bfee-a863e64572f6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:19.890944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4140d5-33f8-4993-bfee-a863e64572f6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:19.891124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4140d5-33f8-4993-bfee-a863e64572f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:19.945181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:19.968154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ac4140d5-33f8-4993-bfee-a863e64572f6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:19.969389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ac4140d5-33f8-4993-bfee-a863e64572f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:20.065383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:20.218802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:20.220288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:20.363541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0012-4679-4da9-b11e-48fe17e61bbb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:20.375345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:20.477646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:20.478179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:20.478459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:20.478762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:20.480377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:20.568302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:20.569922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccf0c-cfe9-41fd-98b7-c00fc3942e3e service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:20.588021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 717/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:21.443642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:21.444199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:21.444199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:21.445599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:21.450724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c32d-771a-40e2-b9a0-ab6e0c7f1a73 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:21.451129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c32d-771a-40e2-b9a0-ab6e0c7f1a73 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:21.451284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c32d-771a-40e2-b9a0-ab6e0c7f1a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:21.471351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:21.526710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4667c32d-771a-40e2-b9a0-ab6e0c7f1a73 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:21.527840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4667c32d-771a-40e2-b9a0-ab6e0c7f1a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:21.625147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:21.772839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:21.774380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:21.883160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:21.921675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70510e44-901a-475f-a866-6f75a1097c34 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:22.151498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:22.152026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:22.152301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:22.152568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:22.154208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:22.228453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:22.242065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:22.243663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90c542-96a3-4b95-b526-49d2e9132376 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:22.262264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 707/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:23.118752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:23.119324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:23.119324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:23.120670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:23.125690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f4d85-fd4b-4556-8bae-da891a37f3d4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:23.126094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f4d85-fd4b-4556-8bae-da891a37f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:23.126248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f4d85-fd4b-4556-8bae-da891a37f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:23.202673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2a9f4d85-fd4b-4556-8bae-da891a37f3d4 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:23.203798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2a9f4d85-fd4b-4556-8bae-da891a37f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:23.313343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:23.462021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:23.464041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:23.546607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:23.609008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18560-ce0a-428f-9be8-dfa2557a6971 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:23.720961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:23.721529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:23.721809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:23.722088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:23.723716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:23.774862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:23.815929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:23.817559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fdb3-a56e-4272-9ff7-12e6bce97d6c service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:23.835743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 720/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:24.635627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:24.636236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:24.636236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:24.637565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:24.642415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b0639-7b19-46ff-b0a4-08e69d0b9ab0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:24.642829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b0639-7b19-46ff-b0a4-08e69d0b9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:24.642990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b0639-7b19-46ff-b0a4-08e69d0b9ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:24.718677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c31b0639-7b19-46ff-b0a4-08e69d0b9ab0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:24.719888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c31b0639-7b19-46ff-b0a4-08e69d0b9ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:24.813691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:57:24.964600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:24.966101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:25.023914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:25.121517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e965f-b75e-4fe4-af8d-bfad7461c0c9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:25.234678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:25.235214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:25.235495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:25.235772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:25.237418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:25.246439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:25.331934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:25.333558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44570bc-2ffa-4dcb-b7e7-57542c359483 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:25.351243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 710/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:26.148112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:26.148646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:26.148646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:26.149979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:26.154932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38c41-b33c-4c66-80de-75a8e200db1d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:26.155371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38c41-b33c-4c66-80de-75a8e200db1d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:26.155504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a38c41-b33c-4c66-80de-75a8e200db1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:26.232761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-11a38c41-b33c-4c66-80de-75a8e200db1d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:26.233992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11a38c41-b33c-4c66-80de-75a8e200db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:26.301342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:26.330859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:26.486429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:26.487864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:26.505713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:26.631803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e1bcb-ae13-4a70-a3e4-5f94114065e0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:26.727771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:26.753833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:26.754378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:26.754656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:26.754927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:26.756522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:26.845318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:26.846926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03e70-7cea-4b40-92f1-95bd3509ede6 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:26.865671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 723/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:27.682627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:27.683187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:27.683187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:27.684561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:27.689364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ff1-8e61-4afe-929d-f02e59d8885a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:27.689799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ff1-8e61-4afe-929d-f02e59d8885a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:27.689913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ff1-8e61-4afe-929d-f02e59d8885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:27.764720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7ffa2ff1-8e61-4afe-929d-f02e59d8885a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:27.765965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ffa2ff1-8e61-4afe-929d-f02e59d8885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:27.807141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:27.864914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:28.015823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:28.017285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:28.162366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbedd91-db94-4440-b80e-a859554f4e91 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:28.216026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:28.274491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009046c5-5336-4415-977c-469920dd0981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:28.275040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009046c5-5336-4415-977c-469920dd0981 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:28.275338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009046c5-5336-4415-977c-469920dd0981 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:28.275616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009046c5-5336-4415-977c-469920dd0981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:28.277236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-009046c5-5336-4415-977c-469920dd0981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:28.367312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009046c5-5336-4415-977c-469920dd0981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:28.368910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009046c5-5336-4415-977c-469920dd0981 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:28.387452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 713/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:29.203618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15726df-8daf-4276-a471-5db970daf0af None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:29.204166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15726df-8daf-4276-a471-5db970daf0af None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:29.204166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15726df-8daf-4276-a471-5db970daf0af None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:29.205454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 19:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:29.210392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3a8e-2d6d-4bdd-a217-3e7cd91cc760 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:29.210840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3a8e-2d6d-4bdd-a217-3e7cd91cc760 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:29.210948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3a8e-2d6d-4bdd-a217-3e7cd91cc760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:29.287070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-876a3a8e-2d6d-4bdd-a217-3e7cd91cc760 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:29.288281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-876a3a8e-2d6d-4bdd-a217-3e7cd91cc760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:29.290304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:29.383810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:57:29.534159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15726df-8daf-4276-a471-5db970daf0af None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:29.535593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f15726df-8daf-4276-a471-5db970daf0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:29.678260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15726df-8daf-4276-a471-5db970daf0af None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:29.704963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:29.788892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:29.789512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:29.789801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:29.790083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:29.791748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:29.879427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:29.881012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a9f7d-5ee6-4a08-9830-eaf3d257e11a service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:29.899400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 726/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:31.794443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:31.794970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:31.795098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:31.796351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:31.801551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8fec-40c2-46ae-b577-51bd00fda339 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:31.801969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8fec-40c2-46ae-b577-51bd00fda339 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:31.802111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8fec-40c2-46ae-b577-51bd00fda339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:31.843685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:31.869505 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-666f8fec-40c2-46ae-b577-51bd00fda339 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:31.870630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-666f8fec-40c2-46ae-b577-51bd00fda339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:31.965951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:32.004392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:32.005974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:32.109642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fd054-732a-4c62-83ec-76a36e6801d4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:32.141095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:32.182668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:32.183296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:32.183575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:32.183852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:32.185500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:32.297940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:32.299382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e296f2c-5b9c-482a-9c94-f99e851acc9f service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:32.317454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 716/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 19:57:34.580236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:34.580775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:34.580775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:34.582197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:34.587431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633fc0-3434-4252-8a19-8ee3e8666d25 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:34.588394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633fc0-3434-4252-8a19-8ee3e8666d25 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:34.588561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633fc0-3434-4252-8a19-8ee3e8666d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:34.654003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-14633fc0-3434-4252-8a19-8ee3e8666d25 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:34.655210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-14633fc0-3434-4252-8a19-8ee3e8666d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:34.668087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:34.751110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:34.788855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:34.790412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:34.895979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e068-a061-44a1-8be1-e50fbcba8ef5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:34.908017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:34.969071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:34.969736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:34.970021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:34.970294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:34.971982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:35.080204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:35.081679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad101f85-5b78-48ec-8526-3c131a019d99 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:35.099499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 729/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:37.421110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:37.421718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:37.421718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:37.423065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:37.428488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6171-6d6f-4c39-af6e-a2218cf3faf0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:37.428946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6171-6d6f-4c39-af6e-a2218cf3faf0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:37.429043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6171-6d6f-4c39-af6e-a2218cf3faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:37.478643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:37.496948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-834c6171-6d6f-4c39-af6e-a2218cf3faf0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:37.498120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-834c6171-6d6f-4c39-af6e-a2218cf3faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:37.594326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:37.632287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:37.633873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:37.736735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afbe74-9115-4664-b99c-f760e7de7386 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:37.776618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:37.810362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:37.810980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:37.811260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:37.811537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:37.813144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:37.922044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:37.923470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b717f2-9ed5-491a-b12f-670a8518f865 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:37.941636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 719/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:40.108206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:40.108764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:40.108764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:40.110165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:40.115531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a750a-35af-433e-b7b8-1348f1b6604b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:40.115966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a750a-35af-433e-b7b8-1348f1b6604b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:40.116095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a750a-35af-433e-b7b8-1348f1b6604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:40.181870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7a1a750a-35af-433e-b7b8-1348f1b6604b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:40.183013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7a1a750a-35af-433e-b7b8-1348f1b6604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:40.203753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:40.278022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:40.316832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:40.318456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:40.421853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24d5-91af-4564-83f0-7a2eb1fe66fd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:40.441862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:40.497449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:40.498066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:40.498348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:40.498929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:40.500586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:40.609177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:40.610642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405960-a392-4bfe-8a37-f44471c6a521 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:40.628895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 732/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:42.703248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:42.703789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:42.703789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:42.705194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:42.710466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db348-9645-46f1-8c9f-6d0f9e9c2015 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:42.710882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db348-9645-46f1-8c9f-6d0f9e9c2015 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:42.711022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db348-9645-46f1-8c9f-6d0f9e9c2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:42.773521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:42.776220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d89db348-9645-46f1-8c9f-6d0f9e9c2015 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:42.778087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d89db348-9645-46f1-8c9f-6d0f9e9c2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:42.873870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:57:42.912079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:42.913669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:43.021438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8427b90-7024-488e-b3f9-4bb84b25bb98 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:43.072426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:43.097701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:43.098312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:43.098590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:43.098859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:43.100483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:43.214121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:43.215664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7432-35dd-4e18-ad48-33c242ded833 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:43.235132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 722/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:45.317113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:45.317680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:45.317680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:45.319062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:45.324325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e2f-7b57-4889-aaac-7705880d54c6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:45.324731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e2f-7b57-4889-aaac-7705880d54c6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:45.324901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b53e2f-7b57-4889-aaac-7705880d54c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:45.390061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e8b53e2f-7b57-4889-aaac-7705880d54c6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:45.391281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e8b53e2f-7b57-4889-aaac-7705880d54c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:45.420987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:45.488579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:45.526104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:45.527629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:45.630250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954654-2c9b-4597-9231-6a74b09201a5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:45.658872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:45.703375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:45.703985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:45.704260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:45.704531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:45.706161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:45.817468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:45.818830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874f1d2-ef5d-4a60-a881-a84c53dfaa0c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:45.837023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 735/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:47.870440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c900-647a-4513-9959-569640dfd883 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:47.870974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c900-647a-4513-9959-569640dfd883 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:47.871073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c900-647a-4513-9959-569640dfd883 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:47.872388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:47.878011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab100e5-4723-49c2-9b43-98ec560d9008 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:47.878391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab100e5-4723-49c2-9b43-98ec560d9008 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:47.878578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab100e5-4723-49c2-9b43-98ec560d9008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:47.944089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6ab100e5-4723-49c2-9b43-98ec560d9008 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:47.945332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6ab100e5-4723-49c2-9b43-98ec560d9008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:47.954069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:48.045805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:48.085447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c900-647a-4513-9959-569640dfd883 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:48.087049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3553c900-647a-4513-9959-569640dfd883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:48.189747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553c900-647a-4513-9959-569640dfd883 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:48.244839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:48.263580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:48.264201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:48.264488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:48.264765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:48.266428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:48.375253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:48.376694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2697c-932e-4fe2-bf77-a73c857af27f service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:48.394785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 725/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:50.432025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:50.432576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:50.432576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:50.433983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:50.439191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a63-42db-43e1-8e15-f1ab53215c8f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:50.439646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a63-42db-43e1-8e15-f1ab53215c8f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:50.439760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab691a63-42db-43e1-8e15-f1ab53215c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:50.505563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ab691a63-42db-43e1-8e15-f1ab53215c8f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:50.506774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ab691a63-42db-43e1-8e15-f1ab53215c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:50.545131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:50.603571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:57:50.643083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:50.644680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:50.747015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179835-6d5e-43b2-af54-4a1045ae7d40 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:50.784115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:50.819938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:50.820558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:50.820847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:50.821125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:50.823406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:50.932600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:50.934090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ebb2e-9a1b-4616-be3e-18cda476c7bf service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:50.952261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 738/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:52.992971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:52.993530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:52.993675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:52.995144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:53.000523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be82a-bac5-4e06-9ab6-812980bd7d80 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:53.000939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be82a-bac5-4e06-9ab6-812980bd7d80 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:53.001080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be82a-bac5-4e06-9ab6-812980bd7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:53.068979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-472be82a-bac5-4e06-9ab6-812980bd7d80 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:53.070295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-472be82a-bac5-4e06-9ab6-812980bd7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:53.091147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:53.168907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:53.205080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:53.206680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:53.310750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283afc0-de10-43db-9858-bc603f8b425b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:53.375763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:53.382799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:53.383416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:53.383696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:53.383967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:53.385665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:53.493007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:53.494518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82425ec-9b2d-4290-8e93-3e3bf7d948a3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:53.513823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 728/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:57:55.519458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:55.520018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:55.520018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:55.521350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 19:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:57:55.526636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818050d-4a73-42bf-896d-199da7f02351 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:55.527075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818050d-4a73-42bf-896d-199da7f02351 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:55.527227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818050d-4a73-42bf-896d-199da7f02351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:55.593539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9818050d-4a73-42bf-896d-199da7f02351 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:57:55.594770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9818050d-4a73-42bf-896d-199da7f02351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:55.642709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:55.692678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:57:55.728846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:57:55.730422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:55.832644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd461-f115-44af-a70c-2d3a17cc40eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:57:55.882080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:57:55.907478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:57:55.908102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:57:55.908389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:57:55.908671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:57:55.910336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:57:56.017138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:57:56.018602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f504266-d412-4c31-96fa-9b879e86e319 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:57:56.037180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 741/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:05.690824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=22 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:06.034589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=66 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:15.539493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4644-9e06-4c51-b232-482bc8bdbe77 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:15.540570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4644-9e06-4c51-b232-482bc8bdbe77 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:15.540570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a4644-9e06-4c51-b232-482bc8bdbe77 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:15.541914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 730/1471] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:15.547044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e5da-3b4b-4eef-80ef-2f49691ecb6c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:15.547486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e5da-3b4b-4eef-80ef-2f49691ecb6c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:15.547609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e5da-3b4b-4eef-80ef-2f49691ecb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:15.613589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ab47e5da-3b4b-4eef-80ef-2f49691ecb6c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:15.614798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ab47e5da-3b4b-4eef-80ef-2f49691ecb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:15.709676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 742/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:15.795434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:15.795737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:15.796021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:15.797392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 731/1473] 10.222.0.42 () {54 vars in 966 bytes} [Thu Jul 28 19:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:15.802043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad571-ab32-4fcc-9c35-45a38a271dae None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:15.802331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad571-ab32-4fcc-9c35-45a38a271dae None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:15.802607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcad571-ab32-4fcc-9c35-45a38a271dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:15.880666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8fcad571-ab32-4fcc-9c35-45a38a271dae None None] MFA Rules not processed for user `7e0f106ea63a4aa781ad03d7583abd89`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:15.882191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8fcad571-ab32-4fcc-9c35-45a38a271dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:15.903600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:15.958975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 743/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Thu Jul 28 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:15.967061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:15.968610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:16.072170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01505-8a72-432b-b63e-118942f19ed1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:16.144776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:16.145430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:16.145715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:16.145990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:16.147632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:16.206924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:16.261939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:16.263381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700712dd-3a7e-4b26-9dd2-838b26c75a5c service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:16.281240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 732/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:18.372397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:18.372923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:18.373039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:18.374355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 744/1476] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:18.379709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e61e4-f60e-4a08-8c8c-8d41069422d1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:18.380113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e61e4-f60e-4a08-8c8c-8d41069422d1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:18.380269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e61e4-f60e-4a08-8c8c-8d41069422d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:18.447251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-162e61e4-f60e-4a08-8c8c-8d41069422d1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:18.448472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-162e61e4-f60e-4a08-8c8c-8d41069422d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:18.545556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 733/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:18.568177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:18.569725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:18.693149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f338-42b0-4164-8a75-62ecc82db01a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:18.740461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:18.784864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:18.785508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:18.785792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:18.786088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:18.787035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:18.788747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:58:18.788747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 19:58:18.788747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 19:58:18.790436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea500f-78eb-4282-8b74-be69924c8e5a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:18.809253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 745/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 19:58:18 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 19:58:20.810052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:20.810622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:20.810622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:20.811942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 734/1479] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:20.817430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b674ab-a835-46a5-b8c1-690d1193910e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:20.817844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b674ab-a835-46a5-b8c1-690d1193910e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:20.817990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b674ab-a835-46a5-b8c1-690d1193910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:20.890462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-23b674ab-a835-46a5-b8c1-690d1193910e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:20.891683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-23b674ab-a835-46a5-b8c1-690d1193910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:20.986936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 746/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:21.030156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:21.031804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:21.042588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:21.178234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302c3e-6df2-4051-bcf5-a349a588bec1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:21.259159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:21.293791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:21.294416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:21.294699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:21.294974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:21.296594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:21.384549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:21.386186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12972c01-e84a-4f66-a0d9-96b2a81afe00 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:21.403809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 735/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:23.576382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:23.576907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:23.576907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:23.578260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 747/1482] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:23.583975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f31f-cebd-4466-817e-357198ccb745 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:23.584491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f31f-cebd-4466-817e-357198ccb745 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:23.584597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f31f-cebd-4466-817e-357198ccb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:23.650839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d179f31f-cebd-4466-817e-357198ccb745 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:23.652047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d179f31f-cebd-4466-817e-357198ccb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:23.697974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:23.747380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 736/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:23.783118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:23.784650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:23.808442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:23.889931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbada80-26aa-40e8-ae19-9cc499ccab95 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:23.966547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:23.967169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:23.967449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:23.967725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:23.969375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:24.043219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:24.078559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:24.080007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985bc97-fdaf-4989-9b45-437e055084b6 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:24.098377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 748/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:26.135379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:26.135935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:26.136044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:26.137383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 737/1485] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:26.142821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70f4-68e5-4418-9eb6-4b1162297136 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:26.143252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70f4-68e5-4418-9eb6-4b1162297136 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:26.143383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db70f4-68e5-4418-9eb6-4b1162297136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:26.214916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-77db70f4-68e5-4418-9eb6-4b1162297136 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:26.215627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77db70f4-68e5-4418-9eb6-4b1162297136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:26.312736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 749/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 19:58:26.350870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:26.352480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:26.459026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c730-1ee8-40ab-873e-9865271a351f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:26.529980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:26.531809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:26.532450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:26.532920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:26.533386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:26.535214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:26.644436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:26.645939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc0823-1a6b-4f2f-b906-f9ffc6b11f61 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:26.664201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 738/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:28.837890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:28.838458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:28.838458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:28.839810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 750/1488] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:28.845065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879ec0-0d1f-40ef-9cfa-732afee1382e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:28.845501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879ec0-0d1f-40ef-9cfa-732afee1382e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:28.845656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879ec0-0d1f-40ef-9cfa-732afee1382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:28.912549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-55879ec0-0d1f-40ef-9cfa-732afee1382e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:28.913780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-55879ec0-0d1f-40ef-9cfa-732afee1382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:28.976148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:29.022345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 739/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:29.062757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:29.064307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:29.101079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:29.169956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76655bc-5268-4c48-8e4f-b040f34254e9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:29.242484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:29.243669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:29.243952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:29.244227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:29.245885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:29.325302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:29.361693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:29.363068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f85fd-b2a6-400a-aabf-bf21c9fdb3ec service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:29.381345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 751/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:31.609432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:31.610012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:31.610012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:31.611625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 740/1491] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 19:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 19:58:31.617230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb0cf-5ba2-4245-9e39-c6e35a45d65b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:31.617753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb0cf-5ba2-4245-9e39-c6e35a45d65b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:31.617938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb0cf-5ba2-4245-9e39-c6e35a45d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:31.685248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5ecbb0cf-5ba2-4245-9e39-c6e35a45d65b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:58:31.686488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5ecbb0cf-5ba2-4245-9e39-c6e35a45d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:31.783772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 752/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:58:31.823989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:58:31.825620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:31.930507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574d3c8-c939-4692-887b-0c07fdb406fc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 19:58:32.005633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 19:58:32.006290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:58:32.006571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:58:32.006843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:58:32.008504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:58:32.017982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:32.117587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 19:58:32.119547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba714f-9010-4db3-ba28-3c9dc4b8b7d5 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 19:58:32.137746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 741/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 19:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 19:58:41.781953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=82 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:42.135535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=50 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:59.589139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:59:59.589747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:59:59.589747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:59:59.675377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:59:59.676578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:59:59.774847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 753/1494] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:59:59.782981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 19:59:59.783476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 19:59:59.783595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 19:59:59.859593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 19:59:59.860728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:59:59.959156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 742/1495] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 19:59:59.964015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 19:59:59.965215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 19:59:59.976577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa745-d1ff-4dd8-8f0b-7a72af5ca9a5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.039738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:00.073567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.074187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.074472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.074749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.075435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:00:00.075740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.076982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.076982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:00:00.076982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:00:00.077919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.089575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 754/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 19:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:00:00.098154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:00.107600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935b7a4-6311-4199-868f-e3342099a95d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.169846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:00.204279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.204924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.205203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.205506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.206177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.207898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.207898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:00:00.207898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:00:00.209684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.265187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 743/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:00:00 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:00:00.269531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:00.271471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:00.305598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6650e4-23e6-4537-b4d8-0866b2aaaca6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.398048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.398674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.398957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.399236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.399917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.400933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.400933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:00:00.400933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:00:00.402196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.445192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 755/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:00:00 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:00:00.449373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:00.450927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:00.513651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f32af8-95d3-4c53-8c16-7ced26ff69b9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.597343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:00.609159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.609880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.610163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.610438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.611126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.612134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.612134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:00:00.612134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:00:00.613025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.626240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 744/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:00:00.630349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:00.631956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:00.643457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3f28-9be7-4459-a2c0-a906a97627e0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.668819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:00.741808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.742463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.742753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.743030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.743735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.744789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.744789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:00:00.744789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:00:00.745722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dcf4b-1837-4960-a070-80053fd493b1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.759087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 756/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:00:00.763373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:00.764948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:00.799204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97be8-fa11-4cb4-bdc5-be914ff8d533 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:00.892641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:00.893367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.893655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.893938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] PATH_INFO: `/v3/projects/aa8e7cc9b37d4a3f847cee0257b8b782/users/de5b401fb4bb4bad847c6c63b662803d/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:00.916889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8e7cc9b37d4a3f847cee0257b8b782, user_id=de5b401fb4bb4bad847c6c63b662803d, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:00.917959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:00.917959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:00:00.917959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:00:00.919912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e765c-1676-4cb4-8877-a097c15a9cd0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:00.945981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 745/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:00:00 2022] PUT /identity/v3/projects/aa8e7cc9b37d4a3f847cee0257b8b782/users/de5b401fb4bb4bad847c6c63b662803d/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:00:00.958539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938abd-b595-4d20-8e25-a8345020128b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:00.958838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938abd-b595-4d20-8e25-a8345020128b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:00.959121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b938abd-b595-4d20-8e25-a8345020128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.016206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7b938abd-b595-4d20-8e25-a8345020128b None None] MFA Rules not processed for user `de5b401fb4bb4bad847c6c63b662803d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:00:01.017342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b938abd-b595-4d20-8e25-a8345020128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:01.092849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 757/1502] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:00:01.106632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.106920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.107196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.108536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 746/1503] 10.222.0.42 () {54 vars in 964 bytes} [Thu Jul 28 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:00:01.113466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536d36-922d-4a0f-81d2-817fd3004d34 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.113761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536d36-922d-4a0f-81d2-817fd3004d34 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.114042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536d36-922d-4a0f-81d2-817fd3004d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.144444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:01.190837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-67536d36-922d-4a0f-81d2-817fd3004d34 None None] MFA Rules not processed for user `10705bb480e94b7484e5a3a4983a7cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:00:01.192060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-67536d36-922d-4a0f-81d2-817fd3004d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:01.265844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 758/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Jul 28 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:00:01.274275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:01.275721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:01.325155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:01.384720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d506e6-f959-4324-a3bc-8d2da846be25 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:01.456997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:01.457649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.457939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.458214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.460381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:01.557743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:01.559104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:01.562563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:01.578471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 747/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:00:01.623778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449193-14c4-4a9f-957c-b1797d5456bf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.624068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449193-14c4-4a9f-957c-b1797d5456bf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.624348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449193-14c4-4a9f-957c-b1797d5456bf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.625771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 759/1506] 10.222.0.42 () {52 vars in 830 bytes} [Thu Jul 28 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:00:01.629923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:01.631710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:01.737572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2513339-d367-4955-a17f-5e19b68da915 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:01.831225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:01.831858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.832057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.832330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] PATH_INFO: `/v3/users/de5b401fb4bb4bad847c6c63b662803d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:01.844853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5b401fb4bb4bad847c6c63b662803d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:01.845913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:01.845913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:00:01.845913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:00:01.847128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:01.857350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:01.913041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5b401fb4bb4bad847c6c63b662803d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:01.925201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5b401fb4bb4bad847c6c63b662803d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:01.925780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5b401fb4bb4bad847c6c63b662803d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:01.926210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5b401fb4bb4bad847c6c63b662803d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:01.944122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5b401fb4bb4bad847c6c63b662803d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:01.959704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 748/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:00:01 2022] DELETE /identity/v3/users/de5b401fb4bb4bad847c6c63b662803d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:00:01.964144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:01.964637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:01.964741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:02.020051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:00:02.021789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:02.095656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:02.109399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 760/1508] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:00:02.119032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:02.120287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:02.219230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb5c10-6241-4912-91bd-a7dafc9e50a6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:02.273245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:02.295139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:02.295799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:02.296086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:02.296367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:02.298060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:02.404462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:02.405876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59d70-1661-4e12-b58e-628a8fd2df83 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:02.424546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 749/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:00:02.765717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:00:02.767740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:00:02.785683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48b57-dde1-493f-bcbf-864e172f5c39 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:00:02.884132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:00:02.884903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:00:02.885047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:00:02.885356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] PATH_INFO: `/v3/projects/aa8e7cc9b37d4a3f847cee0257b8b782` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:00:02.895220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8e7cc9b37d4a3f847cee0257b8b782)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:00:02.896796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:00:02.896796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:00:02.896796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:00:02.898023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:00:02.955483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8e7cc9b37d4a3f847cee0257b8b782', 'request_id': 'req-e2766cc6-31dc-4d22-a10b-8a802dfa03de'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:02.966662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8e7cc9b37d4a3f847cee0257b8b782', 'request_id': 'req-e2766cc6-31dc-4d22-a10b-8a802dfa03de'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:02.973097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8e7cc9b37d4a3f847cee0257b8b782', 'request_id': 'req-e2766cc6-31dc-4d22-a10b-8a802dfa03de'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:03.005134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] The token cache is being invalidate because project aa8e7cc9b37d4a3f847cee0257b8b782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:00:03.005986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:03.006530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e2766cc6-31dc-4d22-a10b-8a802dfa03de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:00:03.008248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 761/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:00:02 2022] DELETE /identity/v3/projects/aa8e7cc9b37d4a3f847cee0257b8b782 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:00:12.422311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=62 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:13.003242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:48.373893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:48.374463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:48.374580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:48.375860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 20:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:01:48.380635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010788-bac3-4bd6-9f2f-a8ee802749f1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:48.381077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010788-bac3-4bd6-9f2f-a8ee802749f1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:48.381187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac010788-bac3-4bd6-9f2f-a8ee802749f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:48.465140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ac010788-bac3-4bd6-9f2f-a8ee802749f1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:01:48.466389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ac010788-bac3-4bd6-9f2f-a8ee802749f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:01:48.571955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:01:48.725715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:01:48.728011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:01:48.852654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80904e98-8d67-47da-9d3c-f3ea2c53589a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:01:48.858385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:01:48.859015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:48.859304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:48.859582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:48.868116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:01:48.869760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634c952-1176-44b0-9b95-249002d2f6f2 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:01:48.879167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 751/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:01:49.706444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672885-ff35-4e58-bbe7-9a9b02c32a36 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:49.706969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672885-ff35-4e58-bbe7-9a9b02c32a36 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:49.706969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672885-ff35-4e58-bbe7-9a9b02c32a36 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:49.708315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 20:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:01:49.713789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fcb2-5d29-4238-a427-1615ca591c39 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:49.714238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fcb2-5d29-4238-a427-1615ca591c39 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:49.714347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fcb2-5d29-4238-a427-1615ca591c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:49.733529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5614fcb2-5d29-4238-a427-1615ca591c39 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:01:49.734725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5614fcb2-5d29-4238-a427-1615ca591c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:01:49.742782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 20:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:01:49.894058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05672885-ff35-4e58-bbe7-9a9b02c32a36 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:01:49.908979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05672885-ff35-4e58-bbe7-9a9b02c32a36 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:01:49.914696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:01:49.915301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:49.915583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:49.915857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:49.923946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:01:49.925556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877afda-da87-4cdb-b7f5-abdcd62a1452 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:01:49.934798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 764/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:01:50.204074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a73d-7ef6-4cbe-a3eb-52b652e28c7f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:50.204362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a73d-7ef6-4cbe-a3eb-52b652e28c7f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:50.204642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a73d-7ef6-4cbe-a3eb-52b652e28c7f None None] PATH_INFO: `/v3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:50.205988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 753/1517] 10.222.0.33 () {54 vars in 925 bytes} [Thu Jul 28 20:01:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:01:50.212819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e996-aceb-4ffc-bb1e-667a329183b3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:50.213114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e996-aceb-4ffc-bb1e-667a329183b3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:50.213428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e996-aceb-4ffc-bb1e-667a329183b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:50.272398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a373e996-aceb-4ffc-bb1e-667a329183b3 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:01:50.274055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a373e996-aceb-4ffc-bb1e-667a329183b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:01:50.291292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:50.344964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 765/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jul 28 20:01:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:01:59.309632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7bff-af2c-417b-9d7f-99877cd57337 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:59.310182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7bff-af2c-417b-9d7f-99877cd57337 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:59.310182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df7bff-af2c-417b-9d7f-99877cd57337 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:59.311436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 754/1519] 10.222.0.42 () {54 vars in 961 bytes} [Thu Jul 28 20:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:01:59.316328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdc8f-4bed-4d21-ac03-646f000a47ce None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:59.316790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdc8f-4bed-4d21-ac03-646f000a47ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:59.316898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fdc8f-4bed-4d21-ac03-646f000a47ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:59.336477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fb8fdc8f-4bed-4d21-ac03-646f000a47ce None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:01:59.337737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fb8fdc8f-4bed-4d21-ac03-646f000a47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:01:59.346312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 766/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Jul 28 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:01:59.354175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7bff-af2c-417b-9d7f-99877cd57337 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:01:59.367604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df7bff-af2c-417b-9d7f-99877cd57337 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:01:59.372590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b91a17-484d-46c5-859c-31017950eece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:01:59.373187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91a17-484d-46c5-859c-31017950eece service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:01:59.373497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91a17-484d-46c5-859c-31017950eece service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:01:59.373775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b91a17-484d-46c5-859c-31017950eece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:01:59.382434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91a17-484d-46c5-859c-31017950eece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:01:59.384114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b91a17-484d-46c5-859c-31017950eece service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:01:59.393799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 755/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:01.168388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6b7d-2481-4dc7-b7ef-32c48fe2ee9b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:01.168941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6b7d-2481-4dc7-b7ef-32c48fe2ee9b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:01.168941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6b7d-2481-4dc7-b7ef-32c48fe2ee9b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:01.170482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 20:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:01.175320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43613ac0-5640-4361-87e8-629457e58feb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:01.175753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43613ac0-5640-4361-87e8-629457e58feb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:01.175885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43613ac0-5640-4361-87e8-629457e58feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:01.196221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-43613ac0-5640-4361-87e8-629457e58feb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:01.197450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-43613ac0-5640-4361-87e8-629457e58feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:01.205314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 20:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:01.358767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a6b7d-2481-4dc7-b7ef-32c48fe2ee9b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:01.373676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a6b7d-2481-4dc7-b7ef-32c48fe2ee9b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:01.379120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:01.379727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:01.380012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:01.380290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:01.388960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:01.390571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4406fb-5d0f-4b98-87bc-ce9c9b924b29 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:01.399903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 768/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:02:02.227649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07212-3860-47fc-8a02-558257f58990 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:02.228272 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07212-3860-47fc-8a02-558257f58990 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:02.228534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07212-3860-47fc-8a02-558257f58990 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:02.230768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 20:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:02.235874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7821-8319-419b-83b1-4bc0f575bc40 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:02.236314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7821-8319-419b-83b1-4bc0f575bc40 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:02.236429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7821-8319-419b-83b1-4bc0f575bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:02.255998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-205c7821-8319-419b-83b1-4bc0f575bc40 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:02.257176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-205c7821-8319-419b-83b1-4bc0f575bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:02.265698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 20:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:02.416655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07212-3860-47fc-8a02-558257f58990 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:02.431377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07212-3860-47fc-8a02-558257f58990 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:02.436903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:02.437545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:02.437829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:02.438101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:02.446286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:02.447869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938111a0-26e1-446d-aff5-385670ff81b5 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:02.457123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 758/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:06.277362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:06.277882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:06.277882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:06.279196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 20:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:06.284351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b137b-e8d5-4ba7-bb1e-f7a1fcf9280e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:06.284793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b137b-e8d5-4ba7-bb1e-f7a1fcf9280e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:06.284912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b137b-e8d5-4ba7-bb1e-f7a1fcf9280e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:06.306318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7e8b137b-e8d5-4ba7-bb1e-f7a1fcf9280e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:06.307503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7e8b137b-e8d5-4ba7-bb1e-f7a1fcf9280e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:06.315182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:06.388131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:06.389918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:06.467199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27c5b-0bc3-4202-b980-db09cefff222 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:06.470746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:06.471354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:06.471633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:06.471908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:06.480728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:06.482177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2591-c7df-4fae-8b9e-40e8a904e534 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:06.491400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 771/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:08.471734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da68f0-2a90-4445-bb05-44179a1e6a63 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:08.472315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da68f0-2a90-4445-bb05-44179a1e6a63 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:08.472315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da68f0-2a90-4445-bb05-44179a1e6a63 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:08.473715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 20:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:08.479510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807134-0dd2-4847-94d3-b9f1334fc461 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:08.479927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807134-0dd2-4847-94d3-b9f1334fc461 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:08.480070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807134-0dd2-4847-94d3-b9f1334fc461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:08.499903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bd807134-0dd2-4847-94d3-b9f1334fc461 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:08.501103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd807134-0dd2-4847-94d3-b9f1334fc461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:08.509012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:08.544859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da68f0-2a90-4445-bb05-44179a1e6a63 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:08.556162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da68f0-2a90-4445-bb05-44179a1e6a63 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:08.559667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:08.560279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:08.560566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:08.560847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:08.569648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:08.571079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b96a-22f0-4c0f-8193-ebe65a49d225 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:08.580520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 761/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:12.074630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:12.075206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:12.075206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:12.076594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 20:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:12.081793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967a38-4b54-4431-9da9-f7224a44443e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:12.082237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967a38-4b54-4431-9da9-f7224a44443e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:12.082346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2967a38-4b54-4431-9da9-f7224a44443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:12.102252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f2967a38-4b54-4431-9da9-f7224a44443e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:12.103440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f2967a38-4b54-4431-9da9-f7224a44443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:12.111765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:12.414903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:12.416575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:12.481097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:12.494416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c093ace-7e93-4a3c-98bc-aa5620edeac8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:12.498032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:12.498651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:12.498936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:12.499217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:12.508203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:12.509741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1496e-c8a4-4f63-91d2-4dde6b02f4bc service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:12.519140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 774/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:14.529468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:14.530039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:14.530039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:14.531385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 20:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:02:14.536760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98ec6-953e-47e3-900f-c1a9f4063d6e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:14.537182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98ec6-953e-47e3-900f-c1a9f4063d6e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:14.537358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98ec6-953e-47e3-900f-c1a9f4063d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:14.556551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4af98ec6-953e-47e3-900f-c1a9f4063d6e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:02:14.557785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4af98ec6-953e-47e3-900f-c1a9f4063d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:14.565617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:02:14.872367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:02:14.874086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:02:14.881680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=84 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:14.888364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614d510-05c0-4904-aac1-d956e707a06f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:02:14.891848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:02:14.892459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:02:14.892739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:02:14.893016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:02:14.902403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:02:14.903818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc3ea-e7a1-4011-b8b8-d55c191ee942 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:02:14.913479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 764/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:02:24.551742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=11 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:24.908929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:44.223519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2790-d330-4897-80ed-36590bb8555f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.224125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2790-d330-4897-80ed-36590bb8555f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.224125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2790-d330-4897-80ed-36590bb8555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.247766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-093d2790-d330-4897-80ed-36590bb8555f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:44.249017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-093d2790-d330-4897-80ed-36590bb8555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:44.264162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 776/1540] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:44.273554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.274151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.274151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.306572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:44.308106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:44.316551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 765/1541] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:44.322181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d2790-d330-4897-80ed-36590bb8555f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.332766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d2790-d330-4897-80ed-36590bb8555f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.339436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.340426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.340941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.341467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.342427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:44.343130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.345187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.365803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 777/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:44.374250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.385225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a40b96-5b3a-4a9a-aaf5-fbd5772e729a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.398386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.399053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.399337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.399897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.400636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.402789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.461709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 766/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:44.466668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.481302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfae43-43d7-4118-b068-0e533ce30379 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.557492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.558125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.558410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.558688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.559358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.561693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099c29f-9ff4-4ef5-b570-9f21661afda7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.595218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 778/1544] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:44.598999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.604152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061af13-db81-4790-b167-91d74365c8ca None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.604453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061af13-db81-4790-b167-91d74365c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.604786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061af13-db81-4790-b167-91d74365c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.619835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff50bb2-bddf-4cac-8118-cd7cae37135d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.628784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.633085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.633245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2061af13-db81-4790-b167-91d74365c8ca None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:44.633473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.633698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.634432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.634565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2061af13-db81-4790-b167-91d74365c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:44.636205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f515a99-ad35-4be3-9ae2-01b58e5cd82b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.650837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 779/1545] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:44.654465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 767/1546] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:44.658039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061af13-db81-4790-b167-91d74365c8ca None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.663121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.663737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.664031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.674143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061af13-db81-4790-b167-91d74365c8ca None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.685988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.686930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.687541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.688051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.688959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.691103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.708879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:44.710818 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:44.711993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 780/1547] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:44.716413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.728786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 768/1548] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:44.733419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.733865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149df3-5f39-4d2a-ba06-59c23414ee21 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.747124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.748330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.748946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.749480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] PATH_INFO: `/v3/projects/2a58c0c47f0d4ea692a6372cb39d7be6/users/c5884d05e8f24fedab500e7d9dd2fd2b/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.752761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333069e6-f422-48ee-8f25-316cb85d46e8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.766069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.769226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.769226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.769226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.769226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:44.769226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.769803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:44.769803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:03:44.769803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:03:44.770775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628aa5-b81c-4d74-8df2-9f63a71af355 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.783222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a58c0c47f0d4ea692a6372cb39d7be6, user_id=c5884d05e8f24fedab500e7d9dd2fd2b, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.785202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:44.785202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:03:44.785202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:03:44.787587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.804137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 769/1549] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:03:44.807711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5295-9e65-4a03-ad10-7835b5820791 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.808912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5295-9e65-4a03-ad10-7835b5820791 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.817550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5295-9e65-4a03-ad10-7835b5820791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.820131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 781/1550] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:44 2022] PUT /identity/v3/projects/2a58c0c47f0d4ea692a6372cb39d7be6/users/c5884d05e8f24fedab500e7d9dd2fd2b/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:44.821295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:44.869909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ce7c5295-9e65-4a03-ad10-7835b5820791 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:44.872845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ce7c5295-9e65-4a03-ad10-7835b5820791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:44.973761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2bb4f-14ea-4198-bfeb-079a8b3f30c4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:44.978992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:44.979620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.979903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.980185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:44.980848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:44.981894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:44.981894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:03:44.981894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:03:44.983086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f392f35-fab0-40f1-a052-820651d7fc67 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:44.990530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 770/1551] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:44.992494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab61fd-5901-4fdf-b337-70d6c1e74eaa None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:44.992793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab61fd-5901-4fdf-b337-70d6c1e74eaa None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:44.993067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab61fd-5901-4fdf-b337-70d6c1e74eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.023484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 782/1552] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.024769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece8f-415d-4a08-b442-9fb84ec811ea None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.025066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece8f-415d-4a08-b442-9fb84ec811ea None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.025462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdece8f-415d-4a08-b442-9fb84ec811ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.029931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-66ab61fd-5901-4fdf-b337-70d6c1e74eaa None None] MFA Rules not processed for user `c5884d05e8f24fedab500e7d9dd2fd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.031785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-66ab61fd-5901-4fdf-b337-70d6c1e74eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.049390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbdece8f-415d-4a08-b442-9fb84ec811ea None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.050640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbdece8f-415d-4a08-b442-9fb84ec811ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.060635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:45.106358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 771/1553] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.107628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555225c-a7a9-4801-9c59-d177000febbe None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.107925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555225c-a7a9-4801-9c59-d177000febbe None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.108199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555225c-a7a9-4801-9c59-d177000febbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.118503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 783/1554] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.119930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988f781-a7bf-40fd-9f1b-749eac951198 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.120245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988f781-a7bf-40fd-9f1b-749eac951198 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.120521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988f781-a7bf-40fd-9f1b-749eac951198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.139297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7555225c-a7a9-4801-9c59-d177000febbe None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.140768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7555225c-a7a9-4801-9c59-d177000febbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.150147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 772/1555] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.150516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d988f781-a7bf-40fd-9f1b-749eac951198 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.151244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef98aa-7416-4ee5-971c-b040545406bc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.151533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef98aa-7416-4ee5-971c-b040545406bc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.151814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef98aa-7416-4ee5-971c-b040545406bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.151929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d988f781-a7bf-40fd-9f1b-749eac951198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.160764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 784/1556] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.162090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.162380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.162653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.175100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-91ef98aa-7416-4ee5-971c-b040545406bc None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.177159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-91ef98aa-7416-4ee5-971c-b040545406bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.193010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 773/1557] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.193010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f114c-b660-4433-9aff-0d98779375c2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.193010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f114c-b660-4433-9aff-0d98779375c2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.193450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.193550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f114c-b660-4433-9aff-0d98779375c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.193655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.200697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 785/1558] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.201917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.212110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cb1f114c-b660-4433-9aff-0d98779375c2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.212952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc21629-a6d1-4c04-a032-83e499f24567 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.213660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb1f114c-b660-4433-9aff-0d98779375c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.220083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.220717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.220996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.221294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.221997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.222645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 774/1559] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.223946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36f70-b269-4b70-97da-4817f3d323d8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.224233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36f70-b269-4b70-97da-4817f3d323d8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.224670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f36f70-b269-4b70-97da-4817f3d323d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.224804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6f03-d9fa-4010-8d56-23310b061ad0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.235799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:45.253108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 786/1560] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.253108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46768-e400-44bb-8f04-8911567099dd None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.253108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46768-e400-44bb-8f04-8911567099dd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.253108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46768-e400-44bb-8f04-8911567099dd None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.253633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 787/1561] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 20:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:03:45.254334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-37f36f70-b269-4b70-97da-4817f3d323d8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.255629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-37f36f70-b269-4b70-97da-4817f3d323d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.258974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21fce-a81b-44e6-ba74-f50824f8c1e2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.259267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21fce-a81b-44e6-ba74-f50824f8c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.259551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21fce-a81b-44e6-ba74-f50824f8c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.264540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 775/1562] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.269374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.269665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.269943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.281959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-92d21fce-a81b-44e6-ba74-f50824f8c1e2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.283275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-92d21fce-a81b-44e6-ba74-f50824f8c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.289505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.290675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.291782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 788/1563] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.292989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7dfab-0e72-459a-ae8a-3ab12435ab85 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.293304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7dfab-0e72-459a-ae8a-3ab12435ab85 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.293590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7dfab-0e72-459a-ae8a-3ab12435ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.299332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 776/1564] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.300095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.310672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e542-c182-4bd0-88b9-0615926a04ba None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.315273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.315894 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.316175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.316450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.317007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-83c7dfab-0e72-459a-ae8a-3ab12435ab85 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.317304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.317628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.318303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-83c7dfab-0e72-459a-ae8a-3ab12435ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.319230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.327288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 789/1565] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.328495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426320-5bcc-44ce-a348-55e1c15f5baf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.328791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426320-5bcc-44ce-a348-55e1c15f5baf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.329065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426320-5bcc-44ce-a348-55e1c15f5baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.334969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 777/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.336094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.350497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed326b1-14b9-4489-9da8-3945011dabdd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.354679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-32426320-5bcc-44ce-a348-55e1c15f5baf None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.355360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.355887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-32426320-5bcc-44ce-a348-55e1c15f5baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.355993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.356277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.356555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.357395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.359025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.366729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 790/1567] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.367842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.368146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.368423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.373982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 778/1568] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:45.374948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.385585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8961bcc-8c48-4bbb-bf11-e7028f0cb7e2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.390183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.390808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.391086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.391363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.392054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.392520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.395232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.407336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 779/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.415530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.415626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:45.415626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:45.420683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c1ac7-9358-4828-8e06-18ad1ee7ef9d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.427525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.428620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.429748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.430272 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.431195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.431520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.433137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.445668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 780/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.446913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.458292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8263-a992-41d5-a676-6ff5eab20501 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.463026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.463648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.463933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.464210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.464916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.465230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.466983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.479479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 781/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.480318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.492823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9707-3fb2-4646-be61-b6cf0555def7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.496762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.497413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.497699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.497978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.498683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.498989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.500593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.508655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 791/1572] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:45.509529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.513221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 782/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.514235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.523986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507dcc6-15ef-4011-a9c0-c0d27a7c1858 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.528565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e249d1-2bc2-429b-b8e8-6cbdac260a0d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.528754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.529424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.529715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.529995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.530695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:45.531003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.532611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.537036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.537732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.538549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.538831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.539503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.541447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.546219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 783/1574] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:45.547038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.558880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424349c-a3ae-42e5-bd44-dfc8a5649b82 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.568168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.568793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.569083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.569397 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.570129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.571726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.579477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 792/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.579477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.586444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 784/1576] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:45.586444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.593170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffd91-16ac-4b53-8e08-860b84b63d7c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.598863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:45.642996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afed1d-548e-4300-a7aa-2a1253891d23 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.648144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.648773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.649136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.649463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.650129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.652143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.655799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.656430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.656924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.657206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.658389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.660569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.681869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 793/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.682955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.692538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 785/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.693776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.731993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:45.754414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f74679-34bf-417f-85c8-5839142aa09e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.769449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9e8c3-92cc-46e1-9ec8-92f8d3e25bc9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.775896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.776520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.776797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.777071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.811574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.812200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.812483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.812758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.813457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.815368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.840490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.842157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.852528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 794/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.852528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.852812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 786/1580] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:45.853607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.864427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73def1-d739-47ad-819f-5b8fb4ec751d service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.894799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:45.922198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7d241-3019-4c63-859b-f00900770372 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:45.927318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.927868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.928153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.928432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.929127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.931079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.935570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:45.936647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:45.936933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:45.937206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:45.937891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:45.939841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:45.960671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 795/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.960671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:45.974344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 787/1582] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:45.976270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.046278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:46.048770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7aead-53eb-4008-bf6c-e0bbf2a265ab admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.052304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232fae-7e78-4efb-ba11-62d3abebd9d7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.055944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.057006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.057612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.058125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.059132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.060827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.061539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.061792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.061909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.062095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] PATH_INFO: `/v3/projects/3351e0ceced741978268aad35d60488f/users/8b6a4bae986142f8b8345265ff33d585/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.079123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3351e0ceced741978268aad35d60488f, user_id=8b6a4bae986142f8b8345265ff33d585, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.082109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.087591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 796/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:45 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.088835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.096989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 788/1584] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:45 2022] PUT /identity/v3/projects/3351e0ceced741978268aad35d60488f/users/8b6a4bae986142f8b8345265ff33d585/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:46.098248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.099216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d78e1f-6bee-4d7f-a1d6-3bb12c4fa093 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.161883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.162630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.163542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.163838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.164496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.165442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771f41-c11a-4857-82b7-9f1844b3957e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.166507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.170324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.170950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.171374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.171658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.172415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.173504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:46.173504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:03:46.173504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:03:46.174765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.188885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 797/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.188885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.199825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 789/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.199825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.202959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac652d-4583-4855-ab6d-a681b08faa77 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.208693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.209490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.209895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.210311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.210423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a0d0-03fa-4145-9b4b-6f544d91a934 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.210996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.213376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.215845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.216463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.216744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.217020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.217721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.219634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.237572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 798/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.239061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.243745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 790/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.244782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.249366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199b36-4bc9-4306-846a-2d8159f8a69d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.254082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.254694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.254978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.255257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.255373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6e44-4e8d-479d-bb86-e07d65078c2e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.255921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.257902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.259953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.260543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.260825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.261099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.261820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.263422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ed33d-5eba-49c6-a9b4-aa330cab1c96 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.274103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 791/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.275305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841f19-bbe2-440d-903e-88eacf3037c0 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.275715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841f19-bbe2-440d-903e-88eacf3037c0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.275994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841f19-bbe2-440d-903e-88eacf3037c0 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.277191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 792/1590] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 20:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:03:46.282096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 799/1591] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.282500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.282963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.283250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.283364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.293877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467c71c-3fae-4155-a892-c9992ffb40b7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.299661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.300447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.300922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.301546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.302537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.306409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.307310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:46.313693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] MFA Rules not processed for user `8b6a4bae986142f8b8345265ff33d585`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:46.314902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:46.325302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 800/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.325302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.336198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0e3f-615a-4ca9-b153-54ec4ea8aa7c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.340773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.341426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.341717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.341994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.342672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.344254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.354742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 801/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.355602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.365209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47132fe-fa19-4093-aed0-9d97e46ab282 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.370681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.371320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.371610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.372072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.372696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.374303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.384804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 802/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.385671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.388871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 793/1595] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:46.389731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.395469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b400e0-5fb3-499a-9311-57897aa78573 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.399569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f2260-9630-4113-bb65-63342b14baa3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.400288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.400915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.401225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.401533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.402210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.403779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6660fc-ce87-4eab-abd8-6bafd86e66cd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.404252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.404850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.405135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.405447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.406137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.407724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.414971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 803/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.416344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.416633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.416911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.418435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 794/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.419128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.429873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca129e-2d22-45e4-9937-04bfb79b590d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.434569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.435163 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.435447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.435731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.436406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.436569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:46.437796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:46.438026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.447929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 795/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.448719 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.457853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237460ed-5d35-47f1-9478-c9eb56c93bf0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.462418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.463002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.463287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.463562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.464234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.465824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.468030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:46.478582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 796/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.479383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.488804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09e507-ea42-4ad1-a654-a2dcd06643f0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.493785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.494409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.494689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.494963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.495643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.497208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.507491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 797/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.508306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.510384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 804/1601] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:46.511344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.520538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e19f-0fd9-4cbc-a26d-8edb8ad67e5b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.524022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10bfbb-3291-4c00-92bf-15874e9066f4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.525861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.526512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.526799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.527079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.527775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.528761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.529398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.529525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.529683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.529958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.530649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.532545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.540447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 798/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.541257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.550778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100bb1-9774-4039-9c6a-3e8ca1a68ccd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.556270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.556989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.557379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.557730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.558491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.560123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.562777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 805/1603] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.563634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.574156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 799/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.574156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.581327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ee31-0c35-4b0c-8802-f720525c7016 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.627127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba0940-9ad2-4baa-8e94-0c8eb8df7f8a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.632479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.633205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.633509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.633798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] PATH_INFO: `/v3/projects/00169220b9644d458ec159decb275c47/users/6f8503fe77164458acb957043e1c57ff/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.641363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.641984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.642263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.643254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.643997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.645681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.648277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00169220b9644d458ec159decb275c47, user_id=6f8503fe77164458acb957043e1c57ff, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.650992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.655614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 800/1605] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:46.656407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.666158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22710-5dc7-451d-b249-335b43e202dc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.667991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 806/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/00169220b9644d458ec159decb275c47/users/6f8503fe77164458acb957043e1c57ff/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:46.668774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.686433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:46.730547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.731221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.731506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.731787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] PATH_INFO: `/v3/projects/09903929fbd14df9bd2e0a2a80ee289a/users/3ebdc0e3b1c648cd96309e5c96c60827/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.732621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea36d3b-cc59-47b2-9346-b9808f624613 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.737210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.737889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.738171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.738446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] PATH_INFO: `/v3/projects/23cc71a370764552af2ce6270a1a0683/users/b3ba082a9ab242d58fb4d15b780f295a/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.746632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09903929fbd14df9bd2e0a2a80ee289a, user_id=3ebdc0e3b1c648cd96309e5c96c60827, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.750382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.753646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cc71a370764552af2ce6270a1a0683, user_id=b3ba082a9ab242d58fb4d15b780f295a, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.756355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.765680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 801/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/09903929fbd14df9bd2e0a2a80ee289a/users/3ebdc0e3b1c648cd96309e5c96c60827/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:46.766574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.769794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 807/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/23cc71a370764552af2ce6270a1a0683/users/b3ba082a9ab242d58fb4d15b780f295a/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:46.771092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.821587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:46.832854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee418-87c2-4908-98f0-4d13ac3cd6b7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.833632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448d7d-2653-41b4-a997-7e7315845523 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.838207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.838885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.839164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.839436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] PATH_INFO: `/v3/projects/46dfdd15a1284dbc938c22ed7cc2b3d3/users/4e9b85efb3e840b69ad3cf319855982f/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.854534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dfdd15a1284dbc938c22ed7cc2b3d3, user_id=4e9b85efb3e840b69ad3cf319855982f, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.857223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.872258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 808/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/46dfdd15a1284dbc938c22ed7cc2b3d3/users/4e9b85efb3e840b69ad3cf319855982f/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:46.875965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.886475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.887081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.887368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.887644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.937486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6317cfe-4b73-49cf-8a99-53443007ea21 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.942292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.942912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.943203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.943490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.944178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.946155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.956306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:46.958148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:46.967042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 809/1610] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:46 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:46.967918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.969408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 802/1611] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:46.970053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:46.979492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403908-6e05-4279-ab1f-d6aad1f0cfba admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.980673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfaf7-c2db-48b1-ad50-41ee1710401f service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:46.984400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.985099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.985233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:46.985412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.985693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] PATH_INFO: `/v3/projects/7636821f30394d2baae53233ca7affdd/users/0d778a3f7d7e477dbcc4b06ba33ded03/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.985814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:46.986094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:46.986368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] PATH_INFO: `/v3/projects/75c31252a1514821bbe33cae997cd7cc/users/7f7ce4ba826f4ed3911e14eae34f3ea2/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:46.995667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:47.004403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7636821f30394d2baae53233ca7affdd, user_id=0d778a3f7d7e477dbcc4b06ba33ded03, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.007267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc34304-34bb-4517-9b7e-ae743a358641 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.008372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c31252a1514821bbe33cae997cd7cc, user_id=7f7ce4ba826f4ed3911e14eae34f3ea2, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.011085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2d11d-b3dc-4f84-96d7-e289a0fe0d4e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.021550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 810/1612] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/7636821f30394d2baae53233ca7affdd/users/0d778a3f7d7e477dbcc4b06ba33ded03/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:47.022887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5d6c-8b0f-4e66-9650-ae68ef5c4d2b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.023220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5d6c-8b0f-4e66-9650-ae68ef5c4d2b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.023508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5d6c-8b0f-4e66-9650-ae68ef5c4d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.028253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 803/1613] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:46 2022] PUT /identity/v3/projects/75c31252a1514821bbe33cae997cd7cc/users/7f7ce4ba826f4ed3911e14eae34f3ea2/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:47.029699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4e930-e08a-431f-abeb-34e9c58bf6b6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.030482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4e930-e08a-431f-abeb-34e9c58bf6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.030765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4e930-e08a-431f-abeb-34e9c58bf6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.046969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-61fd5d6c-8b0f-4e66-9650-ae68ef5c4d2b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.048312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-61fd5d6c-8b0f-4e66-9650-ae68ef5c4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.060853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-caa4e930-e08a-431f-abeb-34e9c58bf6b6 None None] MFA Rules not processed for user `3ebdc0e3b1c648cd96309e5c96c60827`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.062191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-caa4e930-e08a-431f-abeb-34e9c58bf6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.128060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 811/1614] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.129903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.130313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.130735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.137810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 804/1615] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.137810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.137810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.137810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.148913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:47.162898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.165075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.171898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] MFA Rules not processed for user `b3ba082a9ab242d58fb4d15b780f295a`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.173710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.175755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 805/1616] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.176595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.194546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9d8bf-40b1-4060-8e26-a5d5b55f499a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.199319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.199972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.200258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.200542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.201247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.202907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4bca8-e626-4be1-8272-6d6741c7c51a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.217119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 806/1617] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:47.217119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703acf0-ba9c-4400-b285-4782295749a2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.217119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703acf0-ba9c-4400-b285-4782295749a2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.217119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703acf0-ba9c-4400-b285-4782295749a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.236634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a703acf0-ba9c-4400-b285-4782295749a2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.238192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a703acf0-ba9c-4400-b285-4782295749a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.247579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 807/1618] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.248765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefca3-24f4-496d-b5fc-bf2975a9ee67 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.249135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefca3-24f4-496d-b5fc-bf2975a9ee67 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.249518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbefca3-24f4-496d-b5fc-bf2975a9ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.263416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 812/1619] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.263978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.276234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5fbefca3-24f4-496d-b5fc-bf2975a9ee67 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.277521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5fbefca3-24f4-496d-b5fc-bf2975a9ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.286924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 808/1620] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.288903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.289190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.289493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.290764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 809/1621] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 20:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:03:47.296006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.297787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.333735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94f806-eb48-4dda-a3cb-ece884ef84ee None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.338074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.338703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.338986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.339265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.348777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.356690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.357866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ec22a-f669-4117-9f82-219fdd45348d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.360973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.361662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.361976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.362184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.377190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 813/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:47.377730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.378546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.379248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.389730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a9c0a-2f95-4629-b371-8a78da1df6e4 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.393454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 810/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:47.395129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.396044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.396874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.397815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.398348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] PATH_INFO: `/v3/projects/fa402b2758ce45dc95ab938f7035655f/users/fdf1c80918f941fdb92aee4fad8a563a/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.407369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12963d11-c9e8-4a56-81a4-7446a5d54e45 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.412954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.414257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.414559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.415119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.418023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa402b2758ce45dc95ab938f7035655f, user_id=fdf1c80918f941fdb92aee4fad8a563a, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.421177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62786222-c94f-49fc-957d-1f3a4fc4efce admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.425314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:47.427205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.429664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.450262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 811/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:47.450262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.450468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 814/1625] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:47 2022] PUT /identity/v3/projects/fa402b2758ce45dc95ab938f7035655f/users/fdf1c80918f941fdb92aee4fad8a563a/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:47.450468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.450468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.452758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.459562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6283-99a7-4e9d-984b-8b9459dbb9b6 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.501648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:47.504111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:47.584650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.586938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.587486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.588067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.588916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.591269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.632453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 812/1626] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:47.633693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.666158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 815/1627] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:47.667116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.693556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad8a7-699c-458a-94fc-3e71fa91573c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.728722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:47.736301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9dfdd-649d-41e8-93e2-3e938936e093 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.743471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.745059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.745644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.746146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.818686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.820129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.820581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.820904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.821858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.823704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.839737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 816/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:47.839737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.850247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2d384-45d0-48ee-8973-baf6af529590 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.856139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.856854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.857147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.857471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.858147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.860825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.878263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.893853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.896701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 817/1629] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:47 2022] POST /identity/v3/users => generated 309 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:47.897874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.926133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 813/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:47.928199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:47.952614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccb166-bb00-428f-ab12-477edc9c7282 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:47.967020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:47.967798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:47.968085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:47.968368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] PATH_INFO: `/v3/projects/fa402b2758ce45dc95ab938f7035655f/users/fdf1c80918f941fdb92aee4fad8a563a/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:47.972280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa402b2758ce45dc95ab938f7035655f, user_id=fdf1c80918f941fdb92aee4fad8a563a, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:47.976932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:47.990055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 814/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:47 2022] PUT /identity/v3/projects/fa402b2758ce45dc95ab938f7035655f/users/fdf1c80918f941fdb92aee4fad8a563a/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:48.001760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.061315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:48.080229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da06aa-8e9c-4696-8e2b-5d68001b58bc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.125314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d348-9dc1-430a-a669-de385cc851d9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.132682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.133526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.133971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.134882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.135930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.141000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103c353-e4ff-4ab8-906f-7663e37c0d25 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.160136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 815/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:48.160136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.160136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.160136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.206531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] MFA Rules not processed for user `fdf1c80918f941fdb92aee4fad8a563a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:48.208117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:48.225137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.226727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.227117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.228074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.339941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.341663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.344724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 816/1633] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:48.345912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.355327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 818/1634] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:48.356762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.380766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396815-ea5f-434d-b76f-b2a0fa13e370 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.393010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.396416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.396711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.398943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] PATH_INFO: `/v3/projects/537b3413650e413593b9fecf3a3b946f/users/bf86d8fd9968488285ead5024557fbaa/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.404738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:48.438417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=537b3413650e413593b9fecf3a3b946f, user_id=bf86d8fd9968488285ead5024557fbaa, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.446624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.462362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b7f7f-d180-44e0-a88f-b6840bb379bf service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.470831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.471657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.472633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.476122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 817/1635] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:48 2022] PUT /identity/v3/projects/537b3413650e413593b9fecf3a3b946f/users/bf86d8fd9968488285ead5024557fbaa/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:48.476270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.477693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.495045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.500229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.555313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 819/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:48.579142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ebc7-bbde-4af4-a45d-9204cb5c9ccb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.587795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.588425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.588718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.589440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.590715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.592971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.617743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 818/1637] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:48.620543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.646288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f34b59-df94-40c4-9607-65665116ca0f service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.670100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.671069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.671319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.671918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] PATH_INFO: `/v3/projects/537b3413650e413593b9fecf3a3b946f/users/bf86d8fd9968488285ead5024557fbaa/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.677159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537b3413650e413593b9fecf3a3b946f, user_id=bf86d8fd9968488285ead5024557fbaa, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:48.680113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33586ec5-276b-4bcc-93c9-f126138d4783 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:48.698735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:48.715723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 820/1638] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:48 2022] PUT /identity/v3/projects/537b3413650e413593b9fecf3a3b946f/users/bf86d8fd9968488285ead5024557fbaa/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:48.726728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.727035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.727221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.785755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] MFA Rules not processed for user `bf86d8fd9968488285ead5024557fbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:48.786999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:48.824899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:48.844734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a916b-2c1d-411f-bb81-b880729808ce admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:48.957995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 821/1639] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:48.963090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:48.963739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:48.964019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:48.964523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:48.995297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:49.023672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8bd08-2cb7-4671-82f2-1f1d5c62ae54 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:49.034610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:49.035394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.035759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.036113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.054277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:49.055858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013b645-7ef6-4bdb-b763-4a0e3cec5f5c service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:49.077546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 822/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:03:49.078565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:49.082766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d58a-2b1c-412e-b8f0-7ed1894c33bf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.084799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d58a-2b1c-412e-b8f0-7ed1894c33bf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.087461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d58a-2b1c-412e-b8f0-7ed1894c33bf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.094101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 823/1641] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 20:03:49 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:03:49.095730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:49.097572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:49.098613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.098913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.099200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.111674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 819/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:03:49.128237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:49.130856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:49.258940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 824/1643] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:49.299979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:49.380578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:49.410148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88702-a7bd-4f23-8442-921eb528fccb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:49.416364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:49.417401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.418339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.419361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.424865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5347ae-ab67-4fe6-bccf-f94f1f5ad4ef service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:49.434032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:49.434560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.434963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.435280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] PATH_INFO: `/v3/users/3ebdc0e3b1c648cd96309e5c96c60827` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.437360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebdc0e3b1c648cd96309e5c96c60827)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:49.440240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:49.443584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:49.446600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:49.464538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 825/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:03:49.566675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebdc0e3b1c648cd96309e5c96c60827'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.583487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebdc0e3b1c648cd96309e5c96c60827'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.587832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebdc0e3b1c648cd96309e5c96c60827'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.590009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebdc0e3b1c648cd96309e5c96c60827'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.591497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:49.619713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd030-1d4e-4cb2-9337-6f06cc23410e service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:49.635884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d55c66b5-998f-4129-98c3-04a71ad3c4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebdc0e3b1c648cd96309e5c96c60827'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.636819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:49.639273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.639806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.640583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] PATH_INFO: `/v3/users/b3ba082a9ab242d58fb4d15b780f295a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.644789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ba082a9ab242d58fb4d15b780f295a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:49.646964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:49.646964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 28 20:03:49.646964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: Jul 28 20:03:49.653137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:49.676204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 820/1645] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:49 2022] DELETE /identity/v3/users/3ebdc0e3b1c648cd96309e5c96c60827 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:49.685157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae5c9-4aa9-47af-8c63-049efb26899f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.685584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae5c9-4aa9-47af-8c63-049efb26899f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.687020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae5c9-4aa9-47af-8c63-049efb26899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:49.768115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ed2ae5c9-4aa9-47af-8c63-049efb26899f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:49.772835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ed2ae5c9-4aa9-47af-8c63-049efb26899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:49.849250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ba082a9ab242d58fb4d15b780f295a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.873190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ba082a9ab242d58fb4d15b780f295a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.874021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ba082a9ab242d58fb4d15b780f295a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.927969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 821/1646] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:49.928838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ba082a9ab242d58fb4d15b780f295a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.932239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ba082a9ab242d58fb4d15b780f295a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:49.944223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:49.969785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 826/1647] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:49 2022] DELETE /identity/v3/users/b3ba082a9ab242d58fb4d15b780f295a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:49.976351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:49.976653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:49.976967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:50.011712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:50.013456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:50.020162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:50.122625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 822/1648] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:50.160270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:50.169588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:50.193257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:50.202588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:50.317773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbc0bf-de02-4b85-9da0-e453802760e9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:50.326310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:50.327114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:50.327500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:50.327882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:50.330467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:50.350920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:50.353779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:50.358537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e4431-455f-4406-8bb8-4141172bc5c2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:50.367405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 827/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:50.368888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:50.369558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:50.369849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:50.370130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:50.382160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:50.383750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33409a8-3871-4093-ac21-95beae72277a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:50.396183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 823/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:51.088260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:51.089895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:51.124588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70201c-9b24-4a64-851d-90b8d28e5f9c service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:51.140397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:51.141216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:51.141630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:51.142013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] PATH_INFO: `/v3/users/c5884d05e8f24fedab500e7d9dd2fd2b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:51.143708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5884d05e8f24fedab500e7d9dd2fd2b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:51.145951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:51.235232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5884d05e8f24fedab500e7d9dd2fd2b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.251113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5884d05e8f24fedab500e7d9dd2fd2b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.251984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5884d05e8f24fedab500e7d9dd2fd2b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.271717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5884d05e8f24fedab500e7d9dd2fd2b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.276358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5884d05e8f24fedab500e7d9dd2fd2b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.343801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 828/1651] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:51 2022] DELETE /identity/v3/users/c5884d05e8f24fedab500e7d9dd2fd2b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:51.344286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:51.344286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:51.344286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:51.358553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:51.359976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:51.481008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 824/1652] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:51.532651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:51.532764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:51.677758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837cd6-8296-4d84-8eb9-46751616a195 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:51.683078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:51.683967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:51.684510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:51.685167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:51.710761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:51.713193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:51.716708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:51.719437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:51.729748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 829/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:51.747371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:51.750058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:51.751183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5d954-0eee-41c6-8beb-d25e5e999752 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:51.767761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:51.768926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:51.771289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:51.771396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] PATH_INFO: `/v3/projects/09903929fbd14df9bd2e0a2a80ee289a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:51.773809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09903929fbd14df9bd2e0a2a80ee289a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:51.775203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: WARNING py.warnings [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 20:03:51.775203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: warnings.warn(msg) Jul 28 20:03:51.775203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: Jul 28 20:03:51.777103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:51.806269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b552a-343c-4024-947e-68e9881787f0 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:51.815997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:51.818831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:51.819518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:51.820190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] PATH_INFO: `/v3/projects/23cc71a370764552af2ce6270a1a0683` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:51.822400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cc71a370764552af2ce6270a1a0683)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:51.825954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:51.840346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:51.947420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:51.950782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09903929fbd14df9bd2e0a2a80ee289a', 'request_id': 'req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.961758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cc71a370764552af2ce6270a1a0683', 'request_id': 'req-1cb59689-9619-4d73-8c06-54baabcee127'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.977677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09903929fbd14df9bd2e0a2a80ee289a', 'request_id': 'req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:51.997608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cc71a370764552af2ce6270a1a0683', 'request_id': 'req-1cb59689-9619-4d73-8c06-54baabcee127'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.009146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cc71a370764552af2ce6270a1a0683', 'request_id': 'req-1cb59689-9619-4d73-8c06-54baabcee127'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.013478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09903929fbd14df9bd2e0a2a80ee289a', 'request_id': 'req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.031939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] The token cache is being invalidate because project 09903929fbd14df9bd2e0a2a80ee289a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:03:52.033000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.036686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2ecd0c01-ae03-48dc-9e84-5bab09a0a4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.040520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 825/1654] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:03:51 2022] DELETE /identity/v3/projects/09903929fbd14df9bd2e0a2a80ee289a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:52.046620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] The token cache is being invalidate because project 23cc71a370764552af2ce6270a1a0683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:03:52.046926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.047645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.047829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.048299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.048482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.049743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 830/1655] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:03:51 2022] DELETE /identity/v3/projects/23cc71a370764552af2ce6270a1a0683 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:03:52.056888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.058627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.117872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:52.123395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.207282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb59689-9619-4d73-8c06-54baabcee127 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:52.237807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:52.238373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.238657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.244853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] PATH_INFO: `/v3/users/bf86d8fd9968488285ead5024557fbaa` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.246044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf86d8fd9968488285ead5024557fbaa)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:52.248257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:52.302028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 826/1656] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:52.302028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.305064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.358165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6718-70e6-4b86-8f68-50f4ae322efa None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:52.382785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:52.385029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.390832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.393116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf86d8fd9968488285ead5024557fbaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.393716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] PATH_INFO: `/v3/projects/2a58c0c47f0d4ea692a6372cb39d7be6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.399951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a58c0c47f0d4ea692a6372cb39d7be6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:52.406399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:52.417015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf86d8fd9968488285ead5024557fbaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.419048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf86d8fd9968488285ead5024557fbaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.464114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf86d8fd9968488285ead5024557fbaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.465348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-21ac7c4a-e028-4532-be87-6627ed44c34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf86d8fd9968488285ead5024557fbaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.491912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 831/1657] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:52 2022] DELETE /identity/v3/users/bf86d8fd9968488285ead5024557fbaa => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:52.493669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daf16-0294-4bbe-8169-839254613398 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.494156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daf16-0294-4bbe-8169-839254613398 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.494614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179daf16-0294-4bbe-8169-839254613398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.531994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a58c0c47f0d4ea692a6372cb39d7be6', 'request_id': 'req-416a30ef-2f3b-43e9-a890-28dc4fd20fca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.545939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-179daf16-0294-4bbe-8169-839254613398 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:52.550308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-179daf16-0294-4bbe-8169-839254613398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.551907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a58c0c47f0d4ea692a6372cb39d7be6', 'request_id': 'req-416a30ef-2f3b-43e9-a890-28dc4fd20fca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.562089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a58c0c47f0d4ea692a6372cb39d7be6', 'request_id': 'req-416a30ef-2f3b-43e9-a890-28dc4fd20fca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.587837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:52.590113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] The token cache is being invalidate because project 2a58c0c47f0d4ea692a6372cb39d7be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:03:52.590986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.591965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-416a30ef-2f3b-43e9-a890-28dc4fd20fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:52.597109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 827/1658] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:03:52 2022] DELETE /identity/v3/projects/2a58c0c47f0d4ea692a6372cb39d7be6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:52.598903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0c21-982c-40b4-932a-cb2cc659b81a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.599301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0c21-982c-40b4-932a-cb2cc659b81a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.599683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e0c21-982c-40b4-932a-cb2cc659b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.631304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-145e0c21-982c-40b4-932a-cb2cc659b81a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:52.634809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-145e0c21-982c-40b4-932a-cb2cc659b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.761983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:52.781396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 828/1659] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:52.790485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.790644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.790951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.813473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 832/1660] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:52.817936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179daf16-0294-4bbe-8169-839254613398 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.829683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179daf16-0294-4bbe-8169-839254613398 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:52.836664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:52.837880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.838266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.838806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.840000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:52.840433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:52.842661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:52.855125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:52.856360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:52.870453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 833/1661] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:52.874561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.891768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 829/1662] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:52.896051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.907686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d802-4e52-4dd6-b7f8-9da128bb4927 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:52.915836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:52.916687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.917244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.917583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.918270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:52.920263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:52.930525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77bbe2-3380-4751-b5d3-209f89aea596 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:52.949505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:52.950282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:52.950571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:52.950835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:52.951654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:52.951959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:52.953639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:52.989559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 834/1663] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:52 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:52.990723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:52.993463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:53.001315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 830/1664] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:53.002066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.028033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576afa7b-fcae-4478-aa17-db686b436b83 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.182782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb68b8-1723-47d5-8ae2-1769ee3893b6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.193132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.194535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.196852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.197160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] PATH_INFO: `/v3/users/8b6a4bae986142f8b8345265ff33d585` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.201510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6a4bae986142f8b8345265ff33d585)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.204719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.206632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.207416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.207768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.208112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.208860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.211454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.263909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 831/1665] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:53 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:53.263909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.293134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98c76e-ba8f-44ce-8266-f6a233e31e4f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.309401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.310077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.312475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.312806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.312961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6a4bae986142f8b8345265ff33d585'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:53.313550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.319691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.325931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6a4bae986142f8b8345265ff33d585'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:53.326642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6a4bae986142f8b8345265ff33d585'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:53.354193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6a4bae986142f8b8345265ff33d585'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:53.361825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6a4bae986142f8b8345265ff33d585'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:53.377300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 832/1666] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:53 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:53.378767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.382907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:53.399039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:53.425786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 835/1667] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:52 2022] DELETE /identity/v3/users/8b6a4bae986142f8b8345265ff33d585 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:53.431006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.433102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:53.541041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbfbe-84b3-46ed-9f54-364ab6158109 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.726664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36d42f-61ae-444b-86ba-72d1c1a00a4e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.737660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.738323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.738611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.738899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.739620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.747450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982011-9e09-476f-a344-4d906b3ddb4c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.763505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:53.786528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.787188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.787473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.788357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.789042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.795229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.811389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 836/1668] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:53 2022] POST /identity/v3/users => generated 285 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:53.811389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.815027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.815211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.836288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 833/1669] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:53.837194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.859753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01f8b-aa41-4f82-abc9-cd8b3b4cae60 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.871236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:53.872703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:53.878043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.878699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.878982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.879260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.879965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.881656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.888231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 837/1670] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:53.889947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.905596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 834/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:53.909691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.914074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65300aaf-a670-4c5e-8c6d-176963eab3eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.926110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.927482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1653-66a8-4817-963d-1e96a27e8f00 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:53.928338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.932299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.932721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.933699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.934453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:53.935466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:53.935925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:53.945244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:53.946540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:53.948400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.950963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:53.985865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 835/1672] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:03:53.986679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 838/1673] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:53.990444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:53.993196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.020499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f2f4-48ff-4560-b349-aa6be8a0f176 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.021612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b884d0-4c7f-448f-9a28-79537b87a9e1 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.030904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.032066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.032343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.032620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] PATH_INFO: `/v3/projects/4761ab1678c4476a89fcb37683f12695/users/dbc571c2b7b24fd4896fb066f002acec/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.034956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.035653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.035933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.036210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] PATH_INFO: `/v3/projects/4c5e65f57f814e7ea5b9db8aa03b4652/users/082c60b783304f74a1c49c607ba4bd7f/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.073151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5e65f57f814e7ea5b9db8aa03b4652, user_id=082c60b783304f74a1c49c607ba4bd7f, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.074755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4761ab1678c4476a89fcb37683f12695, user_id=dbc571c2b7b24fd4896fb066f002acec, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.085686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce606a7-900b-4afa-8c10-676ce715c08f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.086231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.135384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 836/1674] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:53 2022] PUT /identity/v3/projects/4c5e65f57f814e7ea5b9db8aa03b4652/users/082c60b783304f74a1c49c607ba4bd7f/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:54.136247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.141938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.148435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 839/1675] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:53 2022] PUT /identity/v3/projects/4761ab1678c4476a89fcb37683f12695/users/dbc571c2b7b24fd4896fb066f002acec/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:54.152367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ef38-4a7b-4504-90db-bc2f122bcf14 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.153042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ef38-4a7b-4504-90db-bc2f122bcf14 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.155436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335ef38-4a7b-4504-90db-bc2f122bcf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.200879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e335ef38-4a7b-4504-90db-bc2f122bcf14 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:54.203561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e335ef38-4a7b-4504-90db-bc2f122bcf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.302331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f414-0d47-4a3f-85df-e4549af6d049 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.394094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.394847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.395104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.395459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.398849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 840/1676] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:54.403899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.406361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.407093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.407629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.409508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.421553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 837/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:54.462484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] MFA Rules not processed for user `dbc571c2b7b24fd4896fb066f002acec`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:54.464004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.489971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.492274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.516806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e18ab-c497-44d0-903b-b6607ba01d4f service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.528745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.531693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.532325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.532675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.550912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:54.561215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.562976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.593410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 838/1678] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:03:54.594691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.600349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.635959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 841/1679] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:54.636922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d2b1-e70c-4d80-915a-5b8146078905 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.641041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.651112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.653286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.654432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.654956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] PATH_INFO: `/v3/projects/537b3413650e413593b9fecf3a3b946f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.658154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537b3413650e413593b9fecf3a3b946f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.660641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.668353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c292cb-21a6-402b-9fe5-e427fb28b473 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:54.681156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:54.681988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.684977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.685550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.689152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:54.692793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:54.792534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 842/1680] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:54 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:54.796723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:54.817596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:54.825574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537b3413650e413593b9fecf3a3b946f', 'request_id': 'req-faf9b454-1d6b-47dc-904c-70e2faca3e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:54.844231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537b3413650e413593b9fecf3a3b946f', 'request_id': 'req-faf9b454-1d6b-47dc-904c-70e2faca3e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:54.854327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537b3413650e413593b9fecf3a3b946f', 'request_id': 'req-faf9b454-1d6b-47dc-904c-70e2faca3e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:54.902497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] The token cache is being invalidate because project 537b3413650e413593b9fecf3a3b946f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:03:54.904088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:54.906645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-faf9b454-1d6b-47dc-904c-70e2faca3e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:54.915979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 839/1681] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:03:54 2022] DELETE /identity/v3/projects/537b3413650e413593b9fecf3a3b946f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:54.920714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92f0-5d5f-41dd-bf2c-4f0542c675f5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:54.921794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92f0-5d5f-41dd-bf2c-4f0542c675f5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:54.922253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92f0-5d5f-41dd-bf2c-4f0542c675f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:54.980175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c90e92f0-5d5f-41dd-bf2c-4f0542c675f5 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:54.981617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c90e92f0-5d5f-41dd-bf2c-4f0542c675f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:54.991497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a1182-bdef-44b0-b544-7083e68baf74 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.006168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.007545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.007674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.008039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.008780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.013921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 840/1682] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:55.015944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.016456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.016661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.022534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.077320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 843/1683] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:54 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:55.081163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.082920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:55.085938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:55.090062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:55.116532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 841/1684] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:55.117991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.119002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633308d-4a18-43e3-8e79-6ab6d225ad20 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.137621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.140597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb8f77-3ab2-493c-9efb-63188a93d8a1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.143791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.144453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.145199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.155194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.155999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.156287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.156569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.158060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.160005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.161421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:03:55.161813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.164185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.212708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 844/1685] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:03:55.216267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.229868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 842/1686] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:03:55.233867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.252582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e061-cab2-49f5-81bc-9fd78aa212c3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.258343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fdb9d-4e36-4ba4-a588-920851c71347 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.265491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.266721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.267401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.268671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] PATH_INFO: `/v3/projects/c600c161910048829afe9e4db23f6ddd/users/b4a78ebb07394cffad09ec13e8e0272a/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.269536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.271363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.271957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.274517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.276258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.279576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.327297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c600c161910048829afe9e4db23f6ddd, user_id=b4a78ebb07394cffad09ec13e8e0272a, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.335093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.363551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 845/1687] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:55 2022] PUT /identity/v3/projects/c600c161910048829afe9e4db23f6ddd/users/b4a78ebb07394cffad09ec13e8e0272a/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:55.368894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.378927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 843/1688] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:55 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:55.383698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.518920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b77eec-79f9-4568-a8f0-436b4ca9bcdc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.554504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:55.555503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b648dd-3fc1-4964-9da8-337a0ae0367b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.569595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.570415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.570712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.570995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.571694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.575029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.628810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 844/1689] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:55 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:55.629935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.652057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35590-5f73-4968-adeb-be656b664224 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.664371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.665100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.665483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.665834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.666654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.666750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.667325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.667611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.667891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.668596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.669611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.670260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.693700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 845/1690] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:55.700138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.700548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 846/1691] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:55.701492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.720779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347f90-18e2-4779-bebf-1d46c423eeef admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.729303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60fe51-a5ce-4d37-bb61-c3ca9be80c75 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.736954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.737634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.738098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.738384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.739091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.740756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.749145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.750122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.750622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.751094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] PATH_INFO: `/v3/projects/c600c161910048829afe9e4db23f6ddd/users/b4a78ebb07394cffad09ec13e8e0272a/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.753352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c600c161910048829afe9e4db23f6ddd, user_id=b4a78ebb07394cffad09ec13e8e0272a, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.756416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63aa9-558f-466f-a39b-06f4620ede76 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:55.766772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 846/1692] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:55.767750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:55.786776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4476c3-3252-4028-834f-1b8725eb588a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:55.790723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 847/1693] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:55 2022] PUT /identity/v3/projects/c600c161910048829afe9e4db23f6ddd/users/b4a78ebb07394cffad09ec13e8e0272a/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:55.800976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.801566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.802065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.862849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] MFA Rules not processed for user `b4a78ebb07394cffad09ec13e8e0272a`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:55.864575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:55.916739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:55.939177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:55.939885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:55.940169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:55.940450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] PATH_INFO: `/v3/projects/78288584047a469aadef7b6e69923335/users/e4cb7d1a735d45f9a5062ac6227c9bff/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:55.981550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78288584047a469aadef7b6e69923335, user_id=e4cb7d1a735d45f9a5062ac6227c9bff, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:55.995500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbff43-e648-487e-b6e9-4b143f59d0b7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.036394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 847/1694] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:55 2022] PUT /identity/v3/projects/78288584047a469aadef7b6e69923335/users/e4cb7d1a735d45f9a5062ac6227c9bff/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:56.038045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.038333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.038613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.052892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 848/1695] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:03:56.067104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.069479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:56.096959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] MFA Rules not processed for user `e4cb7d1a735d45f9a5062ac6227c9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:56.098276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:56.209513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d3c5-d187-4ff7-ba8a-faf2a1e849e6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.252974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 848/1696] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:56.258159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.302116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:56.321924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.322853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.323341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.323786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.422575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a105-2f67-409e-bb3a-b9abacb4e28d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.431489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.432140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.432425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.432802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.433463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:56.435412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.475904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:56.477723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.499081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 849/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:03:56.500244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.501750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 849/1697] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:56 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:56.504196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.504875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:56.534818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51fed1-7692-4dac-8e40-6aa87095aafb service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.644896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:56.666877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5148a-9ab6-4031-ab28-016bd131611f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.686002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.686662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.687110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.687347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.688037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:56.690602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.709185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.710677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.711056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.711433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] PATH_INFO: `/v3/projects/3351e0ceced741978268aad35d60488f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.722203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3351e0ceced741978268aad35d60488f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:56.724510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.739559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 850/1699] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:56 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:56.740435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.742385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:56.810935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3351e0ceced741978268aad35d60488f', 'request_id': 'req-6b4c4880-eccb-419c-a08e-283e16ec5ef8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:56.825671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3351e0ceced741978268aad35d60488f', 'request_id': 'req-6b4c4880-eccb-419c-a08e-283e16ec5ef8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:56.840136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760842-9a4a-437a-8770-aa00a07bdc33 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.840924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3351e0ceced741978268aad35d60488f', 'request_id': 'req-6b4c4880-eccb-419c-a08e-283e16ec5ef8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:56.860445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] The token cache is being invalidate because project 3351e0ceced741978268aad35d60488f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:03:56.860748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:56.861773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:56.868333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 850/1700] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:03:56 2022] DELETE /identity/v3/projects/3351e0ceced741978268aad35d60488f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:56.869498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:56.871077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:56.901070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:56.972219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4880-eccb-419c-a08e-283e16ec5ef8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:56.977868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.978512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.978802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.979083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.979952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:56.980756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:56.981831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:56.982604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:56.984451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:56.984846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:56.992558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:57.004699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 851/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:57.007454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:57.013232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:57.046850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213a7c-00cd-4c53-a25f-8bcda79c7208 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:57.059989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:57.061645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:57.061941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:57.063471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] PATH_INFO: `/v3/users/fdf1c80918f941fdb92aee4fad8a563a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:57.065865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf1c80918f941fdb92aee4fad8a563a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:57.071526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:57.144946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:57.147025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:57.166720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf1c80918f941fdb92aee4fad8a563a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:57.167702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 851/1702] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:57.170317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:57.194677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a02ba-2a3b-46f0-a6e7-b3f43aea7453 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:57.209586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:57.210335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf1c80918f941fdb92aee4fad8a563a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:57.210532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:57.210952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:57.211083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf1c80918f941fdb92aee4fad8a563a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:57.211407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] PATH_INFO: `/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14/users/759abf3c2b8546a98709ef49558e5080/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:57.247167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf1c80918f941fdb92aee4fad8a563a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:57.249640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf1c80918f941fdb92aee4fad8a563a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:03:57.249857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1eb14a7c3394b6dac43ce1d98439e14, user_id=759abf3c2b8546a98709ef49558e5080, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:57.254134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:57.277334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 852/1703] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:03:57 2022] DELETE /identity/v3/users/fdf1c80918f941fdb92aee4fad8a563a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:57.285830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 852/1704] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:57 2022] PUT /identity/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14/users/759abf3c2b8546a98709ef49558e5080/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:57.293405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:57.295166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:57.460339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102032-1244-4347-a27f-7a40f6c53bd1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:57.468749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:57.469996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:57.470517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:57.471584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:57.472626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:57.486650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25757-c87c-49f4-9a5b-ebcba80c22db admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:57.504069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 853/1705] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:57.508754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:57.577239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:57.637807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56ee1-213c-4e9e-b168-c18c2ee49628 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:57.656029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:57.656786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:57.657022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:57.657321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] PATH_INFO: `/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14/users/759abf3c2b8546a98709ef49558e5080/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:57.659613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1eb14a7c3394b6dac43ce1d98439e14, user_id=759abf3c2b8546a98709ef49558e5080, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:57.662426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:57.687434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 853/1706] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:57 2022] PUT /identity/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14/users/759abf3c2b8546a98709ef49558e5080/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:03:57.708649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:57.709023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:57.709666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:57.805914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] MFA Rules not processed for user `759abf3c2b8546a98709ef49558e5080`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:57.807302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:57.827321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:57.970300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 854/1707] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:57.983640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:57.985810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:58.093500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b72a3-1935-49b6-8bd5-3680b6fffb5d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:58.106337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:58.107440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:58.107870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:58.108367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:58.124488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:58.140303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1116a-3eca-41e6-9e35-f629ac215091 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:58.159349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 854/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:58.317382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:58.341070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18a6ae-7e80-4064-859e-08cb245bde74 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:58.345529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:58.346349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:58.346776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:58.347214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:58.351439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:58.452467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:58.457892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:58.482615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 855/1709] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:03:58.713222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:58.714090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:58.714509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:58.818244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] MFA Rules not processed for user `082c60b783304f74a1c49c607ba4bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:03:58.822619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:59.044813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 855/1710] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:03:59.048485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:59.051119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:03:59.263861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb702c-7271-4eb3-9789-a07f4c3fd097 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:59.283035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:59.284251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:59.284954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:59.285896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:59.287241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:59.293961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:59.367437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 856/1711] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:03:59 2022] POST /identity/v3/projects => generated 401 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:59.369316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:59.401207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bab690-2443-4627-ba30-ce1438a15dbb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:59.537068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:59.556177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:59.557714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:59.558162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:59.558576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:59.559536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:59.562717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:59.610443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 856/1712] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:03:59 2022] POST /identity/v3/users => generated 307 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:03:59.614040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:59.632830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7196c76-29c4-4af4-9635-0a3e6b517c5c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:59.639290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:59.640326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:59.640968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:59.641497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:59.642399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:59.644205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:59.660424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 857/1713] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:03:59.664434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:59.680593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38e214-8611-434a-bec8-5ceeb639805d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:59.694279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:59.695277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:59.695705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:03:59.696127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] PATH_INFO: `/v3/projects/281c600b530b402492b6a55e83beda48/users/fdedc33a419d4562b07542bf9d36322f/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:03:59.745839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] RBAC: Authorizing `identity:create_grant(project_id=281c600b530b402492b6a55e83beda48, user_id=fdedc33a419d4562b07542bf9d36322f, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:03:59.750328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:03:59.788414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 857/1714] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:03:59 2022] PUT /identity/v3/projects/281c600b530b402492b6a55e83beda48/users/fdedc33a419d4562b07542bf9d36322f/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:03:59.792820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:03:59.811269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80204a-379e-4aa2-b779-d7e57444a0b9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:03:59.886735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:59.998482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:03:59.999714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:03:59.999927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.000221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.000937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:00.002595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:00.038811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:00.039932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 858/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:00.060971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b18a04-4443-44fa-8bdd-def28d86611b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:00.088188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:00.091379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.095209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.095209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] PATH_INFO: `/v3/projects/281c600b530b402492b6a55e83beda48/users/fdedc33a419d4562b07542bf9d36322f/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.096594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:00.098419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:00.101666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=281c600b530b402492b6a55e83beda48, user_id=fdedc33a419d4562b07542bf9d36322f, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:00.120668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd748b-2c35-4fac-aca9-e0429877149b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:00.128941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b595-7e73-4144-b726-245664fd0946 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:00.142779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:00.143618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.144079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.145875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] PATH_INFO: `/v3/projects/fa402b2758ce45dc95ab938f7035655f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.149254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa402b2758ce45dc95ab938f7035655f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:00.155062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:00.159552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 858/1716] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:00 2022] PUT /identity/v3/projects/281c600b530b402492b6a55e83beda48/users/fdedc33a419d4562b07542bf9d36322f/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:00.306344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa402b2758ce45dc95ab938f7035655f', 'request_id': 'req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:00.321543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa402b2758ce45dc95ab938f7035655f', 'request_id': 'req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:00.331912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa402b2758ce45dc95ab938f7035655f', 'request_id': 'req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:00.368558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] The token cache is being invalidate because project fa402b2758ce45dc95ab938f7035655f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:00.368998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:00.373556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3ec31c0-5c89-4fde-af26-32f8c7cb2099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:00.377327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 859/1717] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:00 2022] DELETE /identity/v3/projects/fa402b2758ce45dc95ab938f7035655f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:00.382337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.382787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.383068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.420758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:00.422323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:00.575805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 859/1718] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:00.576239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.576646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.577043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.616622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:00.621660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:00.653959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 860/1719] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:00.655378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:00.669669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a91a-30f7-4396-b157-b478f7b9061e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:00.685103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:00.686071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.686071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.686328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.687297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:00.687611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:00.691788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:00.728462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:00.742264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 860/1720] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:00.742662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4e73-9030-43ce-a115-3c7e7701fa69 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:00.754061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:00.754752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:00.755044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:00.755322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:00.756034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:00.760856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:00.825258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 861/1721] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:00 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:00.830093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:00.846611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29c1b-574a-44a3-9b55-1571396d3a0f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:01.024114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:01.024762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.025048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.025351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.026057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:01.034316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:01.083018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 861/1722] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:00 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:01.086936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:01.098363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e0f5e-beba-4ef9-9042-7e22aa03cbff admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:01.114464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:01.115129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.115938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.116225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.116935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:01.121146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:01.158647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 862/1723] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:01.163708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:01.177859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326a76-d9f6-4117-9777-4c247ca0a6d3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:01.187188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:01.189026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.191832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.192260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.193191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:01.195613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f1b7-82c2-445e-99ef-b3d72cf4bf81 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:01.224242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 862/1724] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:01.228230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:01.239349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9c93-6856-4695-8258-7a89c752f744 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:01.256645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:01.257444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.257875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.258257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] PATH_INFO: `/v3/projects/4b578f8c668745f7b8b8e86079eecf8e/users/57f5fd5265834a4f8f791d31d97d00d8/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.291524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b578f8c668745f7b8b8e86079eecf8e, user_id=57f5fd5265834a4f8f791d31d97d00d8, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:01.294279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:01.364824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 863/1725] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:01 2022] PUT /identity/v3/projects/4b578f8c668745f7b8b8e86079eecf8e/users/57f5fd5265834a4f8f791d31d97d00d8/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:01.374549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.375107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.375555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.412846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:01.428617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] MFA Rules not processed for user `57f5fd5265834a4f8f791d31d97d00d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:01.430214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:01.588167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 863/1726] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:01.589172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:01.714404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:01.770408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc64e6-eb39-4050-8203-83b81e4255d7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:01.795204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:01.796094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:01.796549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:01.796983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:01.798580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:01.800666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:01.883391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 864/1727] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:01 2022] POST /identity/v3/projects => generated 391 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:01.888088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:01.902090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc9ece-f33f-4495-be4a-754663943cbf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.010579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.011573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.011863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.012188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.015988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.018111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.056083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 864/1728] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:01 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:02.056975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:02.081606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cc71-f058-4a3b-bfaa-286af0ead67a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.096814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.097507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.097796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.098078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.098787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.100461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.121573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 865/1729] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:02.126337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:02.139724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c0451-7d86-4a20-9a53-4a7f1445021e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.160002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.162972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.163373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.163664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] PATH_INFO: `/v3/projects/d44629bba733492c93c596b511ad7560/users/fc470483b8ea44acb364750328fcd268/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.227325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44629bba733492c93c596b511ad7560, user_id=fc470483b8ea44acb364750328fcd268, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.257323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.286505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 865/1730] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:02 2022] PUT /identity/v3/projects/d44629bba733492c93c596b511ad7560/users/fc470483b8ea44acb364750328fcd268/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:02.288063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:02.332447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac86a-a9d1-4125-a14a-9aad5f0af0ea admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.486404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.487391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.487705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.488073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.488800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.495751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.526124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 866/1731] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:02.532342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:02.533624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:02.535740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:02.549421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5aa7-e26c-44c1-afec-dd1be4c25124 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.560667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40d857-26dd-4fd7-9666-281b0511825c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:02.572792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.573501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.574750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.575095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:02.575480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] PATH_INFO: `/v3/users/dbc571c2b7b24fd4896fb066f002acec` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.578297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc571c2b7b24fd4896fb066f002acec)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.581667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.581992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.583132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] PATH_INFO: `/v3/projects/d44629bba733492c93c596b511ad7560/users/fc470483b8ea44acb364750328fcd268/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.584011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.596372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44629bba733492c93c596b511ad7560, user_id=fc470483b8ea44acb364750328fcd268, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:02.608931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffe397-cb28-4a7a-8797-844f6321910e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:02.687855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 866/1732] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:02 2022] PUT /identity/v3/projects/d44629bba733492c93c596b511ad7560/users/fc470483b8ea44acb364750328fcd268/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:02.692034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc571c2b7b24fd4896fb066f002acec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:02.697717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc029-b692-491f-9734-8db6c7725430 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.698223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc029-b692-491f-9734-8db6c7725430 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.698889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dc029-b692-491f-9734-8db6c7725430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.705311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc571c2b7b24fd4896fb066f002acec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:02.705893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc571c2b7b24fd4896fb066f002acec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:02.734793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc571c2b7b24fd4896fb066f002acec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:02.737093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e7191db-b1e8-4e83-bac5-049e903c9d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc571c2b7b24fd4896fb066f002acec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:02.783869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 867/1733] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:02 2022] DELETE /identity/v3/users/dbc571c2b7b24fd4896fb066f002acec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:02.790241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:02.790538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:02.790821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:02.799289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-253dc029-b692-491f-9734-8db6c7725430 None None] MFA Rules not processed for user `fc470483b8ea44acb364750328fcd268`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:02.800610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-253dc029-b692-491f-9734-8db6c7725430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:02.854735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:02.855987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:02.896863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:02.948795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:03.018645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 867/1734] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:03.035784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc029-b692-491f-9734-8db6c7725430 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:03.037318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-253dc029-b692-491f-9734-8db6c7725430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.061347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 868/1735] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:03.216782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dc029-b692-491f-9734-8db6c7725430 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:03.226325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:03.228574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.229378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.229839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.260408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:03.270082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0a080-5db9-4302-bcaa-b9cb6b41db79 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:03.296528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 868/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:03.320352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:03.323319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.347699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077836-cbe3-4baf-b45d-472bfbffa2d5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.347994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077836-cbe3-4baf-b45d-472bfbffa2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.348280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077836-cbe3-4baf-b45d-472bfbffa2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.462174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-43077836-cbe3-4baf-b45d-472bfbffa2d5 None None] MFA Rules not processed for user `7f7ce4ba826f4ed3911e14eae34f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:03.465741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-43077836-cbe3-4baf-b45d-472bfbffa2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.519198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328777ea-3999-41a0-87f8-b42bf5a8bb32 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:03.530701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:03.531403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.532918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.533394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.559461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:03.560940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:03.582589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 869/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:03.583487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:03.588558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.617656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6caa-2edd-417d-b03f-fcaddcbdfc41 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:03.627540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:03.628255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.628474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.628758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.629418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 869/1738] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:03.637864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.638166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.638437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.641258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.686322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] MFA Rules not processed for user `7f7ce4ba826f4ed3911e14eae34f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:03.687615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.712055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 870/1739] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:03.723896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:03.727164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:03.789876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:03.792307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d650ee7-c708-4eca-b1b4-daae49f82c7e service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:03.814931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 870/1740] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:03.860790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:03.873103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd64f30-b2bb-4e25-9ab0-ed2295afb08d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:03.881425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:03.882393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:03.883192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:03.883816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:03.948701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:03.951272 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd623558-998d-4fc1-bb74-7a7c2a8ce887 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:03.965765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 871/1741] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:04.166704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:04.167026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:04.167319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:04.267581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] MFA Rules not processed for user `6f8503fe77164458acb957043e1c57ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:04.268858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:04.484370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:04.563816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7a19-43c3-4a90-91af-0b7982e7f306 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:04.564121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7a19-43c3-4a90-91af-0b7982e7f306 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:04.564569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7a19-43c3-4a90-91af-0b7982e7f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:04.564794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 871/1742] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:04.627776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-366f7a19-43c3-4a90-91af-0b7982e7f306 None None] MFA Rules not processed for user `6f8503fe77164458acb957043e1c57ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:04.629026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-366f7a19-43c3-4a90-91af-0b7982e7f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:04.653307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 872/1743] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:04.669767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:04.671312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:04.692224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582716-c725-4da7-a938-fbf8eed0ad47 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:04.698447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:04.700722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:04.701154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:04.701608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:04.715387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:04.718160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c756-fd88-4d7a-a24d-4a023830d2f3 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:04.748098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 872/1744] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:04.782344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8ca9-ad79-40eb-b940-52d8958ef4b9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:04.782639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8ca9-ad79-40eb-b940-52d8958ef4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:04.782944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8ca9-ad79-40eb-b940-52d8958ef4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:04.800990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:04.802112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:04.802585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:04.878796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] MFA Rules not processed for user `fdedc33a419d4562b07542bf9d36322f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:04.881598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-860f8ca9-ad79-40eb-b940-52d8958ef4b9 None None] MFA Rules not processed for user `0d778a3f7d7e477dbcc4b06ba33ded03`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:04.884400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:04.889435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-860f8ca9-ad79-40eb-b940-52d8958ef4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.083155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 873/1745] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:05.138438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 873/1746] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:05.192171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:05.193426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.222518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525ecdd-224e-48c0-9c4f-b15ceb3bbbed None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:05.233373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:05.234053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.234334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.234612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] PATH_INFO: `/v3/projects/4761ab1678c4476a89fcb37683f12695` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.238023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4761ab1678c4476a89fcb37683f12695)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:05.240014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:05.382009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4761ab1678c4476a89fcb37683f12695', 'request_id': 'req-3040006e-6fc7-4d5a-a360-5ca8072dd361'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.419390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4761ab1678c4476a89fcb37683f12695', 'request_id': 'req-3040006e-6fc7-4d5a-a360-5ca8072dd361'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.429978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4761ab1678c4476a89fcb37683f12695', 'request_id': 'req-3040006e-6fc7-4d5a-a360-5ca8072dd361'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.431658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718edd8-8e6d-4ffa-8fad-9457adedba97 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.432154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718edd8-8e6d-4ffa-8fad-9457adedba97 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.432625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718edd8-8e6d-4ffa-8fad-9457adedba97 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.436191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 874/1747] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 20:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:04:05.445484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.445761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.446158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.467404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] The token cache is being invalidate because project 4761ab1678c4476a89fcb37683f12695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:05.468266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.471106 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.477351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 874/1748] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:05 2022] DELETE /identity/v3/projects/4761ab1678c4476a89fcb37683f12695 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:05.482564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:05.484228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.548189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:05.549538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.627446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:05.667165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040006e-6fc7-4d5a-a360-5ca8072dd361 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:05.675638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:05.676462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.677511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.678014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] PATH_INFO: `/v3/users/b4a78ebb07394cffad09ec13e8e0272a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.680712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a78ebb07394cffad09ec13e8e0272a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:05.686975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:05.721051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 875/1749] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:05.785961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a78ebb07394cffad09ec13e8e0272a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.795648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:05.797309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.798432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a78ebb07394cffad09ec13e8e0272a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.799451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a78ebb07394cffad09ec13e8e0272a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.823714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f4318-febc-41e4-bcb9-54e5e1cee4c9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:05.824948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a78ebb07394cffad09ec13e8e0272a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.825919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ead7aaf6-f178-4d29-a9ab-49cc71a22305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a78ebb07394cffad09ec13e8e0272a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:05.832981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:05.833660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.834000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.834796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.843533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:05.850331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 875/1750] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:05 2022] DELETE /identity/v3/users/b4a78ebb07394cffad09ec13e8e0272a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:05.885931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca88c-aebf-42fd-807c-7dc0bea4645e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.886458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca88c-aebf-42fd-807c-7dc0bea4645e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.887295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca88c-aebf-42fd-807c-7dc0bea4645e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.890093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 876/1751] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 20:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 20:04:05.891885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:05.893563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:05.900531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539e55-68bb-493d-8a11-2e15dd2732a6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:05.900917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539e55-68bb-493d-8a11-2e15dd2732a6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:05.901361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539e55-68bb-493d-8a11-2e15dd2732a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:05.912279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 876/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:05.976851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-12539e55-68bb-493d-8a11-2e15dd2732a6 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:05.984921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-12539e55-68bb-493d-8a11-2e15dd2732a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:06.157287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 877/1753] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:06.246103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:06.248257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:06.267539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e5627-8938-42c1-8d14-ac315af70fc0 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:06.285010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:06.288827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:06.289120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:06.289433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:06.326916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:06.329284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:06.364638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 877/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:06.859873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:06.859873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:06.859873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:06.895881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] MFA Rules not processed for user `4e9b85efb3e840b69ad3cf319855982f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:06.898498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:06.989039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 878/1755] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:07.329920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:07.331630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:07.511414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:07.548591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:07.551502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:07.561884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:07.608539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbf0d9-4359-4b37-ae9e-5c1197308794 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:07.628863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:07.629022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:07.629339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:07.629624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] PATH_INFO: `/v3/projects/c600c161910048829afe9e4db23f6ddd` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:07.631472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c600c161910048829afe9e4db23f6ddd)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:07.633705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:07.762623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c600c161910048829afe9e4db23f6ddd', 'request_id': 'req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:07.773616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c600c161910048829afe9e4db23f6ddd', 'request_id': 'req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:07.781659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c600c161910048829afe9e4db23f6ddd', 'request_id': 'req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:07.799027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d372dbe-a861-4571-a063-94ac2c663a8c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:07.804895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] The token cache is being invalidate because project c600c161910048829afe9e4db23f6ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:07.805428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:07.807142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:07.809377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 878/1756] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:07 2022] DELETE /identity/v3/projects/c600c161910048829afe9e4db23f6ddd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:07.810422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:07.822168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:07.936119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:07.940248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:07.940873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:07.941449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:07.947582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:07.976558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c31f-96aa-45b5-9d12-d679fa8d498e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:07.989522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:07.990240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:07.990530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:07.990817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] PATH_INFO: `/v3/users/e4cb7d1a735d45f9a5062ac6227c9bff` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:07.992203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cb7d1a735d45f9a5062ac6227c9bff)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:07.994061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:08.058297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:08.062293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb30e9-1041-4392-b41e-a9c0cef2d8b3 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:08.093579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 879/1757] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:08.095767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e26d9-d524-49bb-ae1d-2fea677f7989 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.096914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e26d9-d524-49bb-ae1d-2fea677f7989 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.097549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e26d9-d524-49bb-ae1d-2fea677f7989 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.100629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 880/1758] 10.222.0.42 () {54 vars in 961 bytes} [Thu Jul 28 20:04:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:04:08.102028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b493-b250-4954-a290-bff4f7a83eb8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.105593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b493-b250-4954-a290-bff4f7a83eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.106078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b493-b250-4954-a290-bff4f7a83eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.106717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cb7d1a735d45f9a5062ac6227c9bff'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:08.138025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cb7d1a735d45f9a5062ac6227c9bff'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:08.139701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cb7d1a735d45f9a5062ac6227c9bff'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:08.140491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cb7d1a735d45f9a5062ac6227c9bff'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:08.194534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1cd74f39-bcb5-4d83-b86c-34955563c892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cb7d1a735d45f9a5062ac6227c9bff'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:08.198344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:08.215105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9c92b493-b250-4954-a290-bff4f7a83eb8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:08.221156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c92b493-b250-4954-a290-bff4f7a83eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.226802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 879/1759] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:07 2022] DELETE /identity/v3/users/e4cb7d1a735d45f9a5062ac6227c9bff => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:08.228330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.228725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.229191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.230880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 880/1760] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:04:08.231684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:08.234149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.263232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 881/1761] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:08.264684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.264983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.265284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.317358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:08.317358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.430759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:08.487216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59e651-6f68-4956-8e5a-5c26c6044b5b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:08.495683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:08.496337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.496626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.496904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.506525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.565960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 882/1762] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Jul 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:08.567927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:08.572149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.620087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7a53f-0201-48ac-bdab-1a8c425e88fb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:08.642655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:08.644888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.645965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.647028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.675832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.712293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:08.714102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29571340-557b-4e87-a7fa-ced5cff6a065 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:08.726531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:08.734604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73389f19-229d-4af0-bcdb-7cde7ed7738b service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:08.763722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 881/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:08.765130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.765473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.765760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.783741 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 883/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:08.786203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73cb15-a9e7-4f83-8c72-66885b1040df None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:08.788197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73cb15-a9e7-4f83-8c72-66885b1040df None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:08.791870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73cb15-a9e7-4f83-8c72-66885b1040df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:08.824537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:08.832237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:08.846782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2d73cb15-a9e7-4f83-8c72-66885b1040df None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:08.850070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d73cb15-a9e7-4f83-8c72-66885b1040df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.092048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 884/1765] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:09.095224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4312d8-5942-4035-aea1-1d43457c1fc6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.098817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4312d8-5942-4035-aea1-1d43457c1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.098817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4312d8-5942-4035-aea1-1d43457c1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.124895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 882/1766] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:09.124895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:09.156336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75253709-ba2a-46e2-b97b-a4f1e5d797d8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:09.169306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bb4312d8-5942-4035-aea1-1d43457c1fc6 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:09.170357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bb4312d8-5942-4035-aea1-1d43457c1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.175733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:09.176842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.177135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.177452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.202180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:09.204865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:09.210593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 885/1767] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:09.211600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.211898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.212179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.232406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 883/1768] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:09.234799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:09.243096 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.280752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] MFA Rules not processed for user `7f7ce4ba826f4ed3911e14eae34f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:09.293742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.294425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3fee-de0c-49c1-8b25-235bf3402225 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:09.308858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:09.309625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.309975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.310263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] PATH_INFO: `/v3/users/57f5fd5265834a4f8f791d31d97d00d8` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.313088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f5fd5265834a4f8f791d31d97d00d8)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:09.315127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:09.360180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:09.459575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f5fd5265834a4f8f791d31d97d00d8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:09.496160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f5fd5265834a4f8f791d31d97d00d8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:09.497977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f5fd5265834a4f8f791d31d97d00d8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:09.499320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f5fd5265834a4f8f791d31d97d00d8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:09.553770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f5fd5265834a4f8f791d31d97d00d8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:09.569352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 886/1769] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:09.570596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:09.583639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.599270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 884/1770] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:09 2022] DELETE /identity/v3/users/57f5fd5265834a4f8f791d31d97d00d8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:09.601395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:09.603911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.663992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae48f0-b4e1-49b9-ae75-012de7ab0a56 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:09.776757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002c8c7-e30e-45a1-9c2d-cb20c3459f38 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:09.792106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:09.805502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.806786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.807905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.816538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:09.907523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:09.936131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:09.937840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:09.938244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:09.938624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:09.939555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:09.950660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:09.960615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:10.013774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 887/1771] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:10.014981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:10.020298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.065359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:10.071953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:10.172531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 885/1772] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:10.173714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:10.184196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.240306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ebc44-8912-4031-9c17-ed4f61cda2ff service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:10.279468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:10.279468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:10.279739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:10.279815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] PATH_INFO: `/v3/users/082c60b783304f74a1c49c607ba4bd7f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:10.292290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=082c60b783304f74a1c49c607ba4bd7f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:10.294318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:10.343304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683e22-4161-423e-95df-76c75824679c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:10.359311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:10.361889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:10.363074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:10.376730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:10.388854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.435019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:10.438724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:10.440395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc6db-c05b-412c-8389-f779e9fefebf service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:10.473301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082c60b783304f74a1c49c607ba4bd7f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:10.483185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 888/1773] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:10.506464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:10.506464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:10.506464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:10.527992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082c60b783304f74a1c49c607ba4bd7f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:10.531310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082c60b783304f74a1c49c607ba4bd7f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:10.534681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082c60b783304f74a1c49c607ba4bd7f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:10.589357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082c60b783304f74a1c49c607ba4bd7f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:10.602265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:10.608514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.638711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 886/1774] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:10 2022] DELETE /identity/v3/users/082c60b783304f74a1c49c607ba4bd7f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:10.644829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:10.652750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.653601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 889/1775] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:10.757162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:10.759930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:10.811608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad479d-abcd-43d3-9e95-0303172ba1a8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:10.829320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4487b-59d5-487b-84e6-255324f8b91b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:10.847770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:10.848769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:10.849992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:10.850370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:10.851157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:10.860256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:10.924355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 887/1776] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:10 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:10.929684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:11.084484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f0cb-6aac-4369-922b-0028c8492a20 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:11.095557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.096442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.096733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.097023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.099169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.100012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.102085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.103727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.104420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:11.104960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.151378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.152871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:11.160287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 888/1777] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:10 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:11.161296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:11.202417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 890/1778] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:11.204269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a405adb-cbf7-49f7-950e-2cf6d4bbc68d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:11.222002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.222719 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.223014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.223298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.225649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.229807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:11.264305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:11.277100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 889/1779] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:11.284556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8160-cc18-4100-a52c-5836c79a9be5 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:11.319793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.320422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.324184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.324499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.341924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.343801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea15d-44e9-4d19-8877-7b068c8ad818 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:11.374748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 891/1780] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:11.378788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:11.393968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd45a-1697-4649-a00f-122b5c711316 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:11.428248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.430021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.430309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.430600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] PATH_INFO: `/v3/projects/916915b863764bc3a33d75f6ecfdf126/users/d24616fc2a8f433ea9725a4fc7c73982/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.474227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:11.485690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=916915b863764bc3a33d75f6ecfdf126, user_id=d24616fc2a8f433ea9725a4fc7c73982, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.488392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:11.543502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 890/1781] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:11 2022] PUT /identity/v3/projects/916915b863764bc3a33d75f6ecfdf126/users/d24616fc2a8f433ea9725a4fc7c73982/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:11.545372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.545719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.546003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.633585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] MFA Rules not processed for user `d24616fc2a8f433ea9725a4fc7c73982`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:11.635694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:11.774427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:11.803685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 892/1782] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:11.809007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:11.965864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1c6d-c71a-40db-a22e-1794e49c3cdd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:11.981925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:11.982695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:11.982848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:11.983115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:11.983808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:11.985979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.057585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 891/1783] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:11 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:12.059143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.092740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b5d8a-de4c-4dcf-b068-c3f9a5170412 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.229652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.229901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.230078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.230322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.231322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.232508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.234594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.234994 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:12.254634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60434a48-ce58-4ca4-b3d6-0744a3883165 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.263232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.264690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.265999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.266503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] PATH_INFO: `/v3/projects/4c5e65f57f814e7ea5b9db8aa03b4652` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.280633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5e65f57f814e7ea5b9db8aa03b4652)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.299568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 893/1784] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:12 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:12.300526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.302689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.325582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93fc8a-e5cd-4518-804f-17c7617acd07 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.344384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.345609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.345609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.345609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.346348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.347983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.388816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 894/1785] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:12.394452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.420401 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0ad3-151f-4d1f-8c28-4a443016dfff admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.457521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5e65f57f814e7ea5b9db8aa03b4652', 'request_id': 'req-77d11d1f-09bd-4914-8253-56591ed9dd84'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:12.482945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5e65f57f814e7ea5b9db8aa03b4652', 'request_id': 'req-77d11d1f-09bd-4914-8253-56591ed9dd84'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:12.503217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5e65f57f814e7ea5b9db8aa03b4652', 'request_id': 'req-77d11d1f-09bd-4914-8253-56591ed9dd84'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:12.540905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] The token cache is being invalidate because project 4c5e65f57f814e7ea5b9db8aa03b4652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:12.542150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:12.543052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:12.549591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 892/1786] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:12 2022] DELETE /identity/v3/projects/4c5e65f57f814e7ea5b9db8aa03b4652 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:12.551606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.554224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:12.570617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.571324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.571610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.577365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] PATH_INFO: `/v3/projects/ebbb249442254794bae3fef6d4403c94/users/2b21b6800c3b4cdd9957ecce089b177b/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.649244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbb249442254794bae3fef6d4403c94, user_id=2b21b6800c3b4cdd9957ecce089b177b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.653197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.691112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 895/1787] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:12 2022] PUT /identity/v3/projects/ebbb249442254794bae3fef6d4403c94/users/2b21b6800c3b4cdd9957ecce089b177b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:12.692289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:12.697841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:12.741476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:12.747903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11d1f-09bd-4914-8253-56591ed9dd84 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.909519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:12.924406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66a7c-aca4-463d-a19b-bf2bd2880cbb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:12.929398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.932630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.934474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.936989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] PATH_INFO: `/v3/projects/78288584047a469aadef7b6e69923335` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.943545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78288584047a469aadef7b6e69923335)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.947915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:12.948058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:12.948996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:12.949257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:12.949566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] PATH_INFO: `/v3/users/fdedc33a419d4562b07542bf9d36322f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:12.950776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdedc33a419d4562b07542bf9d36322f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:12.952728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:13.085762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdedc33a419d4562b07542bf9d36322f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.100493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78288584047a469aadef7b6e69923335', 'request_id': 'req-a936f21d-f356-415e-9c27-7e63e6ef5d44'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.107299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdedc33a419d4562b07542bf9d36322f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.108180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdedc33a419d4562b07542bf9d36322f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.130177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78288584047a469aadef7b6e69923335', 'request_id': 'req-a936f21d-f356-415e-9c27-7e63e6ef5d44'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.141387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78288584047a469aadef7b6e69923335', 'request_id': 'req-a936f21d-f356-415e-9c27-7e63e6ef5d44'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.149330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdedc33a419d4562b07542bf9d36322f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.155430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdedc33a419d4562b07542bf9d36322f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.198971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] The token cache is being invalidate because project 78288584047a469aadef7b6e69923335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:13.199653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.201469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.204747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 896/1788] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:12 2022] DELETE /identity/v3/users/fdedc33a419d4562b07542bf9d36322f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:13.205634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:13.207011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:13.210144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 893/1789] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:12 2022] DELETE /identity/v3/projects/78288584047a469aadef7b6e69923335 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:13.214099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:13.220326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:13.445445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4119af-b395-4556-88a9-3b372f509d6a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:13.459765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936f21d-f356-415e-9c27-7e63e6ef5d44 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:13.463748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:13.464740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:13.465257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:13.465752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:13.466893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:13.468817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:13.469537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:13.469887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:13.470174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] PATH_INFO: `/v3/users/759abf3c2b8546a98709ef49558e5080` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:13.471566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495c8e-a100-4cc8-a268-9c202e1b4ca0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:13.473572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759abf3c2b8546a98709ef49558e5080)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:13.476544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:13.498807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 897/1790] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:13.500416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7733-0ffe-443e-8910-f7170c1eb4e7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:13.500908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7733-0ffe-443e-8910-f7170c1eb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:13.501428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7733-0ffe-443e-8910-f7170c1eb4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:13.526121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:13.541523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759abf3c2b8546a98709ef49558e5080'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.553417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759abf3c2b8546a98709ef49558e5080'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.554630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759abf3c2b8546a98709ef49558e5080'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.556166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759abf3c2b8546a98709ef49558e5080'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.572963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759abf3c2b8546a98709ef49558e5080'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:13.596348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 894/1791] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:13 2022] DELETE /identity/v3/users/759abf3c2b8546a98709ef49558e5080 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:13.596759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:13.598220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:13.621757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f41a7733-0ffe-443e-8910-f7170c1eb4e7 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:13.623134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f41a7733-0ffe-443e-8910-f7170c1eb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:13.712108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:13.733220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5a8b-73cd-4358-9d1e-cebe120cf517 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:13.741677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:13.742980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:13.743413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:13.743917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] PATH_INFO: `/v3/projects/ebbb249442254794bae3fef6d4403c94/users/2b21b6800c3b4cdd9957ecce089b177b/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:13.746711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbb249442254794bae3fef6d4403c94, user_id=2b21b6800c3b4cdd9957ecce089b177b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:13.763532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:13.768434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 898/1792] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:13.792829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 895/1793] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:13 2022] PUT /identity/v3/projects/ebbb249442254794bae3fef6d4403c94/users/2b21b6800c3b4cdd9957ecce089b177b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:13.797108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:13.797777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:13.798070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:13.898319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] MFA Rules not processed for user `2b21b6800c3b4cdd9957ecce089b177b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:13.899554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:14.015615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:14.017501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:14.029371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 899/1794] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:14.043213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:14.050308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:14.193891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3310cbc-20a8-454e-9543-07d48917b469 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:14.198672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:14.199559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:14.200160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:14.200584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:14.204823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:14.276479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890b38-6bb7-490c-88f6-d63f2ed973bb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:14.293110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:14.296761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:14.297081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:14.300098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:14.376825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:14.402157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:14.403688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:14.443073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 900/1795] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:14.494484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:14.497045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:14.534974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 896/1796] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 20:04:14.795271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:14.796963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:14.920898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:15.054110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0d5b7-372f-488c-b285-a5f6a41ae7df service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:15.076719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:15.078449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:15.080456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:15.080765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] PATH_INFO: `/v3/projects/4b578f8c668745f7b8b8e86079eecf8e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:15.090600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b578f8c668745f7b8b8e86079eecf8e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:15.097527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:15.215180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b578f8c668745f7b8b8e86079eecf8e', 'request_id': 'req-ac823eab-afdd-4a17-bf88-f59976358e56'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.230622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b578f8c668745f7b8b8e86079eecf8e', 'request_id': 'req-ac823eab-afdd-4a17-bf88-f59976358e56'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.285828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b578f8c668745f7b8b8e86079eecf8e', 'request_id': 'req-ac823eab-afdd-4a17-bf88-f59976358e56'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.318803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] The token cache is being invalidate because project 4b578f8c668745f7b8b8e86079eecf8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:15.319113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.334533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.342308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 901/1797] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:14 2022] DELETE /identity/v3/projects/4b578f8c668745f7b8b8e86079eecf8e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:15.346754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:15.373968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dc4da-ffc5-4cb0-9c7f-0bb78cc7feae service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:15.530193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:15.532596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:15.534320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:15.535781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] PATH_INFO: `/v3/users/fc470483b8ea44acb364750328fcd268` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:15.544044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc470483b8ea44acb364750328fcd268)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:15.550896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:15.607728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:15.610588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:15.656849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac823eab-afdd-4a17-bf88-f59976358e56 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:15.682326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:15.683074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:15.683454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:15.683701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc470483b8ea44acb364750328fcd268'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.683806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] PATH_INFO: `/v3/projects/281c600b530b402492b6a55e83beda48` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:15.687979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] RBAC: Authorizing `identity:delete_project(project_id=281c600b530b402492b6a55e83beda48)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:15.691558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:15.714540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc470483b8ea44acb364750328fcd268'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.716526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc470483b8ea44acb364750328fcd268'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.718893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc470483b8ea44acb364750328fcd268'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.782840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1430a82a-51a5-4849-8b36-10cb7c515ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc470483b8ea44acb364750328fcd268'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.824832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 897/1798] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:15 2022] DELETE /identity/v3/users/fc470483b8ea44acb364750328fcd268 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:15.866345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281c600b530b402492b6a55e83beda48', 'request_id': 'req-e3a277fc-dac5-4d1a-82d7-329a5029511b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.881360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281c600b530b402492b6a55e83beda48', 'request_id': 'req-e3a277fc-dac5-4d1a-82d7-329a5029511b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.890032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281c600b530b402492b6a55e83beda48', 'request_id': 'req-e3a277fc-dac5-4d1a-82d7-329a5029511b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.923676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] The token cache is being invalidate because project 281c600b530b402492b6a55e83beda48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:15.923973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.926465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3a277fc-dac5-4d1a-82d7-329a5029511b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:15.933603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 902/1799] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:15 2022] DELETE /identity/v3/projects/281c600b530b402492b6a55e83beda48 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:15.944373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:15.944879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:15.945406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.020828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:16.022408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:16.122936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:16.173643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 898/1800] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:16.183392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:16.183705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:16.183991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.257977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:16.259967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:16.292336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:16.303167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 903/1801] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:16.309766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926cd3a-8d56-4525-a7c7-b7627bfd0692 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:16.323072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:16.323896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:16.324290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:16.324728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.325805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:16.326282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:16.328507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:16.363453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 899/1802] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:16.371512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:16.384092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641a45-f2b6-4cf5-b138-112126296c0b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:16.395661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:16.397047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:16.400952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:16.401488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.402426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:16.411510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:16.476209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:16.478296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:16.497493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 904/1803] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:16 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:16.499479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:16.528100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:16.762617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754be41-4d57-4e7e-806d-fae7c0984393 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:16.784124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3857ae-6d55-4d1b-bd7a-de3c3fc60d21 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:16.796508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:16.797383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:16.797715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:16.798076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.798744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:16.805015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:16.850939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 905/1804] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:16 2022] POST /identity/v3/users => generated 282 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:16.850939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:16.855098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:16.891671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bf76b-8674-4188-b684-5d697922e183 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:16.902712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:16.903376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:16.903781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:16.903929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] PATH_INFO: `/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:16.906787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1eb14a7c3394b6dac43ce1d98439e14)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:16.908380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:17.000309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:17.001110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.001528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.002001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.007275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:17.110071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1eb14a7c3394b6dac43ce1d98439e14', 'request_id': 'req-6ba4a37c-b97f-40c1-a669-375609f04074'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:17.133821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1eb14a7c3394b6dac43ce1d98439e14', 'request_id': 'req-6ba4a37c-b97f-40c1-a669-375609f04074'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:17.154751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1eb14a7c3394b6dac43ce1d98439e14', 'request_id': 'req-6ba4a37c-b97f-40c1-a669-375609f04074'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:17.183292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:17.186425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:17.203638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] The token cache is being invalidate because project e1eb14a7c3394b6dac43ce1d98439e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:17.204033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:17.207879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6ba4a37c-b97f-40c1-a669-375609f04074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:17.215592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 900/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:17.216629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:17.219715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 906/1806] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:16 2022] DELETE /identity/v3/projects/e1eb14a7c3394b6dac43ce1d98439e14 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:17.221211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.221571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.225488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.229282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f0ff-2ce8-4421-8d44-f1b1392d7f09 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:17.297938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:17.299331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:17.301958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:17.354605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:17.355436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.356503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.357464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.359601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:17.366099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432a27-7826-4485-aa7a-4be458708bd6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:17.409567 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 901/1807] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:17.413024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2041-860a-462e-a349-3acb31783f47 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.415200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2041-860a-462e-a349-3acb31783f47 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.415697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce2041-860a-462e-a349-3acb31783f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.553481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 907/1808] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:17.554722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:17.563956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:17.565184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f8ce2041-860a-462e-a349-3acb31783f47 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:17.568971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f8ce2041-860a-462e-a349-3acb31783f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:17.596646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d55d31-64d0-4a6f-9e28-885abfd79605 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:17.611967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:17.612981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.613568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.614193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.616224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:17.619720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4a83-c254-4a96-9dc4-b1c38a3ead8f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:17.645434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 908/1809] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:17.650228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.650780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.651213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.698987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:17.703511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:17.732397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 909/1810] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:17.733645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:17.743288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:17.767215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008bb0e-a9b0-42b2-8718-976a60a7ff1f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:17.776706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:17.777780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.778991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.779416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] PATH_INFO: `/v3/projects/b971546d1e9943a1987039494ecd76e9/users/c4a7191648b14fa5a00eea6cbf59652a/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.815117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971546d1e9943a1987039494ecd76e9, user_id=c4a7191648b14fa5a00eea6cbf59652a, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:17.819909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:17.843024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 910/1811] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:17 2022] PUT /identity/v3/projects/b971546d1e9943a1987039494ecd76e9/users/c4a7191648b14fa5a00eea6cbf59652a/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:17.845803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:17.877708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 902/1812] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jul 28 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:17.884865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:17.885688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:17.886213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:17.945449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] MFA Rules not processed for user `c4a7191648b14fa5a00eea6cbf59652a`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:17.948075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:18.031884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73073c13-d7a5-48e0-9d6b-40e984dab72e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.047207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.048423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.053423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.053863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.055826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:18.057090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.061180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.095345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 911/1813] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:18.095345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.098634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:18.144974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 903/1814] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:18.147389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.182081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfdee7-36da-4295-9345-914ff827c78d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.197090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.199317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.200711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.204199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.205257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.213248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.256631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b89ce-6fbe-46c2-92a0-ae3fc5981ccf admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.262058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.263531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.264345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.264848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.275813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.278252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.290837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 912/1815] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:18.292415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.310777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82d475-8bb0-4603-b254-db6f318cc6a2 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.313625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 904/1816] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:18.317674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.455868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.456635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.457070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.457482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.459912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.464340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371793ae-cd9c-462c-8763-025752431790 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.497694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28feb5-2126-4c14-a6ae-d6bfcb4832c8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.498710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:18.506273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.507911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.508349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.508997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.512301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.513285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.539116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:18.558321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 913/1817] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:18.559792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.560192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.560582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.569523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 905/1818] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:18.572603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.594390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb60d-2afe-4879-b651-60b74a675ab5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.596774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] MFA Rules not processed for user `4e9b85efb3e840b69ad3cf319855982f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:18.599242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:18.720114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.721024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.722940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.722940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.724907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.728729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471a5c-c5ea-4209-90b9-1312945f81da admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.747618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 914/1819] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:18.749133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.765196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 906/1820] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:18.767535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.768029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.768237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.780707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d875-1241-489b-810e-90eb6a7990ad None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.790666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.791753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.792297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.792804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.793773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.795609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.798502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] MFA Rules not processed for user `0d778a3f7d7e477dbcc4b06ba33ded03`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:18.800820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:18.820773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 915/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:18.822645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.824742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:18.843655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0400-6392-4361-9a07-698e0f1c00e0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.848780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.850543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.851104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.851607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] PATH_INFO: `/v3/projects/d44629bba733492c93c596b511ad7560` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.853369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44629bba733492c93c596b511ad7560)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.855619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:18.959502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 907/1822] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:18.960397 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:18.983315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcdfd2-d5d8-4469-8e66-2dc31dde4b95 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:18.990823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:18.991697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:18.992027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:18.992304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:18.993636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:18.996671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:19.013685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 908/1823] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:19.015126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:19.028182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b867de-9c4c-4d70-8d61-2cf35ce54c93 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:19.068233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44629bba733492c93c596b511ad7560', 'request_id': 'req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:19.105019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44629bba733492c93c596b511ad7560', 'request_id': 'req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:19.130355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44629bba733492c93c596b511ad7560', 'request_id': 'req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:19.186226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] The token cache is being invalidate because project d44629bba733492c93c596b511ad7560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:19.186522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:19.191148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:19.203768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 916/1824] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:18 2022] DELETE /identity/v3/projects/d44629bba733492c93c596b511ad7560 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:19.205575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:19.212965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:19.219502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:19.220159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.225806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.226111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.229319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:19.235827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7a2ac-bca6-48ee-a4a2-0129f263eac6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:19.275059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 909/1825] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:19.275059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.275416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.275712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.309135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525d5cb-0f51-4f57-b4d7-ec27efc9c108 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:19.312575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:19.319562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:19.323668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.324344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.325000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] PATH_INFO: `/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc/users/be7b743f422c416a92734c445d7e2fee/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.354695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:19.357606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:19.372950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d13a24a9949b9b2e64a2278f8f3dc, user_id=be7b743f422c416a92734c445d7e2fee, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:19.386432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cdde2-585c-44c3-bfb4-fa4d17ab654b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:19.397621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 910/1826] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:19.399922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:19.405208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:19.414868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 917/1827] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:19 2022] PUT /identity/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc/users/be7b743f422c416a92734c445d7e2fee/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:19.427483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.427780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.428065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.442798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b9fd4-a213-4a2f-b9eb-f3fd0467d52c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:19.506266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:19.508468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:19.628946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:19.653005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:19.663169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.663169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.663587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] PATH_INFO: `/v3/projects/b39915bef2694413a2d1c8ec2c070141/users/e05746a92b374a69ad3c08b57acd1b1e/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.687043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 918/1828] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:19.689652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:19.707801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d521-7fd9-45c5-ad07-5533650fc6a1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:19.712471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39915bef2694413a2d1c8ec2c070141, user_id=e05746a92b374a69ad3c08b57acd1b1e, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:19.715162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:19.723576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:19.724442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.724889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.725160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.726622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:19.729796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50252600-0eb6-458d-9f61-aa261f1b9708 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:19.742545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 911/1829] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:19 2022] PUT /identity/v3/projects/b39915bef2694413a2d1c8ec2c070141/users/e05746a92b374a69ad3c08b57acd1b1e/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:19.743431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:19.757078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 919/1830] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:19.758314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.758314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.758314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.835536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] MFA Rules not processed for user `e05746a92b374a69ad3c08b57acd1b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:19.836236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:19.941256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd2dd-2f5d-4486-9bc9-8d89a2bda39a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:19.954685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:19.957730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:19.958795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:19.959652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:19.963204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:19.963819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:19.968260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.023834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 912/1831] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:20.025439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.044795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 920/1832] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:20.046513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.052747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ac37-74f2-406b-851a-44ee1fca7a9b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.064889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.066591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.067119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.068686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] PATH_INFO: `/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc/users/be7b743f422c416a92734c445d7e2fee/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.075271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d13a24a9949b9b2e64a2278f8f3dc, user_id=be7b743f422c416a92734c445d7e2fee, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.078412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e42f-02d1-45b5-8b1e-88af772417f2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.085901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.096016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.097338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.098593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.099608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.102759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.105483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4b4a3-cdd4-4282-90a6-737d2ea74371 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.124375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 913/1833] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:20 2022] PUT /identity/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc/users/be7b743f422c416a92734c445d7e2fee/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:20.126508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.184326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 921/1834] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:20 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:20.189257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.193847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.194463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.288878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] MFA Rules not processed for user `be7b743f422c416a92734c445d7e2fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:20.293100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:20.320611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a246e-4581-4f39-ad04-24f4e7c0a455 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.334637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:20.541680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.542647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.542980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.543262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.543959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.547514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.551761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 922/1835] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:20.553239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.597327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26203499-5943-4906-b1ed-b02640c7fa1a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.606323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.607374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.607664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.607928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.608764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.611890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.639809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 914/1836] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:20 2022] POST /identity/v3/projects => generated 375 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:20.640390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.648619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:20.651462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 923/1837] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:20 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:20.652585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.690357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f518c1-c9b4-4023-a3f2-195a95f42f08 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.728946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:20.746255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e55850-0ffe-49c4-9e63-e78f30490009 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:20.758483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.759402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.759691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.759972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.860858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.862613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:20.889976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 915/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:20.892266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:20.936482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:20.937607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:20.938142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:20.938582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:20.939459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:20.945027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.038635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 924/1839] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:20 2022] POST /identity/v3/users => generated 294 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:21.050385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:21.057874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.095586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d17a-4fda-4856-aa65-4a73aa7c54aa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.103255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dcc8-4a8f-49eb-b4a5-37b7d3ce496f service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.144335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.144992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.145300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.145590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.146891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.147002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.147782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.148212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.148514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.148799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.149667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.151459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.193318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 925/1840] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:21.194233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.197309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 916/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:21.202139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.235452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fbabc-02df-4eae-af65-dc6444210ade admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.245614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1356d-5e9f-40b3-8d30-86d083c9da98 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.260811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.261490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.261774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.262048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.262760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.264402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.267839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.268558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.268847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.269128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] PATH_INFO: `/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22/users/a9b3ceca031a485db038587e43bda4ff/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.289911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 917/1842] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:21.293834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.317060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cc48f-5b57-422c-a64e-e9617345b2b4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.335251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.335251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.335251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.335251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] PATH_INFO: `/v3/projects/5e9b2389702445dab55dd13633837a7b/users/62692fe975db459eb33a2d3ea54e0bb3/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.341684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d0d39e0f9944e1a4fca8712ba5aa22, user_id=a9b3ceca031a485db038587e43bda4ff, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.351287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.374943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9b2389702445dab55dd13633837a7b, user_id=62692fe975db459eb33a2d3ea54e0bb3, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.381221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2e2b6-991f-47da-a3be-0730371e04d0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.381853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 926/1843] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:21 2022] PUT /identity/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22/users/a9b3ceca031a485db038587e43bda4ff/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:21.384973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.434748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 918/1844] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:21 2022] PUT /identity/v3/projects/5e9b2389702445dab55dd13633837a7b/users/62692fe975db459eb33a2d3ea54e0bb3/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:21.449131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.456680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.456680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.504159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c0a5a-089f-4ff4-a123-8ab19b5f9c2f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.565001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] MFA Rules not processed for user `62692fe975db459eb33a2d3ea54e0bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:21.566683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:21.751303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 919/1845] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:21.756079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.803963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.804926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.805718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.806200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.807258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.809926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.866369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 927/1846] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:21.868932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:21.904539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa343ca-447b-481a-b98c-d7d2ada526a4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.914038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.914693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.914980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.915093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acfdd-e113-4dee-942a-afbab414fa1c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:21.915288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.915939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.918069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.935620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:21.936878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:21.937657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:21.950180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] PATH_INFO: `/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22/users/a9b3ceca031a485db038587e43bda4ff/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:21.964216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d0d39e0f9944e1a4fca8712ba5aa22, user_id=a9b3ceca031a485db038587e43bda4ff, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:21.976426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f6500-35b7-41af-9da0-85acdb9bbccd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:21.994515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 920/1847] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:21 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:21.998887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:22.028102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 928/1848] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:21 2022] PUT /identity/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22/users/a9b3ceca031a485db038587e43bda4ff/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:22.040500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:22.041077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:22.041494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:22.054765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:22.077774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:22.141421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] MFA Rules not processed for user `a9b3ceca031a485db038587e43bda4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:22.148678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:22.238959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00448f-c4f2-4e0d-9e7c-3921acc4e026 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:22.394746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 929/1849] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:22.396444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:22.518429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:22.519076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:22.519453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:22.520222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:22.520559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:22.525363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:22.554675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fb724-9568-4cc9-ab4b-54fcedd00254 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:22.573031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:22.573967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:22.575478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:22.576458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] PATH_INFO: `/v3/users/c4a7191648b14fa5a00eea6cbf59652a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:22.582197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a7191648b14fa5a00eea6cbf59652a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:22.585743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:22.644965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 921/1850] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:21 2022] POST /identity/v3/users => generated 298 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:22.647085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:22.726254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a7191648b14fa5a00eea6cbf59652a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:22.742549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a7191648b14fa5a00eea6cbf59652a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:22.743180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a7191648b14fa5a00eea6cbf59652a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:22.792725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a7191648b14fa5a00eea6cbf59652a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:22.794898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a7191648b14fa5a00eea6cbf59652a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:22.843583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 930/1851] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:22 2022] DELETE /identity/v3/users/c4a7191648b14fa5a00eea6cbf59652a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:22.843774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878052-266b-422d-a59d-1789b832a617 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:22.844422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:22.849322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:22.873559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:23.012483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:23.013083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.013478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.013810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.015793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.037557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee0cff-213c-4747-ab03-2d6a56c8ecec admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:23.051082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:23.061569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:23.061950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.062240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.062511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] PATH_INFO: `/v3/users/d24616fc2a8f433ea9725a4fc7c73982` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.070003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24616fc2a8f433ea9725a4fc7c73982)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:23.072061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:23.117130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:23.119871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:23.135855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 922/1852] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:23.137003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:23.138812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.161984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc125d-0b6d-46b8-ae5f-dd4c20f292d4 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:23.177505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:23.181679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.182173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.182817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.184251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:23.194137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f03695-e01a-41a0-b8f1-36e8c6e4fe20 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:23.205159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24616fc2a8f433ea9725a4fc7c73982'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:23.220752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24616fc2a8f433ea9725a4fc7c73982'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:23.221478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24616fc2a8f433ea9725a4fc7c73982'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:23.229737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 923/1853] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:23.236787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b672-afdf-4e4d-9574-5fe430e5499e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.238199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b672-afdf-4e4d-9574-5fe430e5499e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.238681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b672-afdf-4e4d-9574-5fe430e5499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.257516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24616fc2a8f433ea9725a4fc7c73982'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:23.261222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-89ffb7a3-0b74-4af4-8e72-d501911b9941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24616fc2a8f433ea9725a4fc7c73982'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:23.314555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 931/1854] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:22 2022] DELETE /identity/v3/users/d24616fc2a8f433ea9725a4fc7c73982 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:23.314555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.314555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.314555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.319172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 932/1855] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:04:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:04:23.320165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:23.323657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.331968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c0b5b672-afdf-4e4d-9574-5fe430e5499e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:23.353519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c0b5b672-afdf-4e4d-9574-5fe430e5499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.525987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68997ae-840e-4b87-8c72-bb89dc1ed718 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:23.539797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:23.540488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.540945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.541965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] PATH_INFO: `/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b/users/3a9973d5846d457289e08ff44393f340/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.576688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83b556ee7a845f7bf77fb2ceba0e83b, user_id=3a9973d5846d457289e08ff44393f340, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:23.581754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13d6a-af9c-469b-a7af-bf109380d5e1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:23.612785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 933/1856] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:23 2022] PUT /identity/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b/users/3a9973d5846d457289e08ff44393f340/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:23.615649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.615943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.616314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.663120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 924/1857] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:23.669739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.671384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.671800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:23.672015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.673885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.689881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:23.751474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:23.762413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:23.928602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 934/1858] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:23.930530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:23.969673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b75e-bdc9-4bd1-901c-f59c343e70aa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:23.992643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:23.993513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:23.993630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:23.993876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:23.994590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:24.010711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:24.054065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 935/1859] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:24.056053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:24.060665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:24.143579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 925/1860] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:24.146408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:24.183675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d7ea8-4da7-4b30-bb00-1f3b49a0b1de None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:24.206006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:24.208001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:24.210286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:24.210705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] PATH_INFO: `/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b/users/3a9973d5846d457289e08ff44393f340/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:24.216187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83b556ee7a845f7bf77fb2ceba0e83b, user_id=3a9973d5846d457289e08ff44393f340, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:24.229607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:24.300056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 926/1861] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:24 2022] PUT /identity/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b/users/3a9973d5846d457289e08ff44393f340/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:24.300056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:24.300056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:24.309912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83379b-6893-4a88-9958-a85edcb77152 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:24.437945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:24.438629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:24.438908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:24.439542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:24.539441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:24.539650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:24.540948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4413aa-0f0c-480a-9b9a-26b9d5abf50c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:24.591084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 936/1862] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:24.592399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:24.592695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:24.597382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:24.607524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55bf9-c7c5-47d9-b700-d0f3e775345e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:24.620513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:24.621644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:24.622361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:24.622361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:24.644523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:24.646507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c1ac-126e-4ce3-9339-13fad39c74e7 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:24.654217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:24.700592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 927/1863] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:24.736309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] MFA Rules not processed for user `3a9973d5846d457289e08ff44393f340`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:24.739179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:24.956650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:24.957034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:24.957423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:24.958996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 928/1864] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 20:04:25.101174 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 937/1865] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:25.108622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:25.110573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:25.416713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d220cb-0b0d-4aae-825e-dfcc9f65ddad None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:25.429655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:25.441723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:25.442511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:25.443970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:25.493624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:25.495944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3770e-cb17-487b-bea8-704b3d2a9bf9 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:25.527903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 929/1866] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:25.826951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:25.847065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77465f92-5e9c-44bb-a0e8-f2e39db4dd87 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:25.868834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:25.870207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:25.870802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:25.871245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] PATH_INFO: `/v3/users/62692fe975db459eb33a2d3ea54e0bb3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:25.873020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62692fe975db459eb33a2d3ea54e0bb3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:25.876262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:25.948605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:25.948896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:25.949183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:25.965965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62692fe975db459eb33a2d3ea54e0bb3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:25.980395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62692fe975db459eb33a2d3ea54e0bb3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:25.981433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62692fe975db459eb33a2d3ea54e0bb3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:25.999504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62692fe975db459eb33a2d3ea54e0bb3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.000583 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e3c284aa-d130-42b6-8783-5d33ca812107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62692fe975db459eb33a2d3ea54e0bb3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.001088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:26.002358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.019708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 938/1867] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:25 2022] DELETE /identity/v3/users/62692fe975db459eb33a2d3ea54e0bb3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:26.023914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:26.024567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:26.025098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:26.051502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:26.053701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.147834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 939/1868] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:26.184131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 930/1869] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:26.188862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:26.193604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.233963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:26.241047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:26.243499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.279007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b398b8-36bf-40bb-bb0e-75977718e712 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:26.297063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:26.297989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:26.298411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:26.298705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] PATH_INFO: `/v3/projects/b971546d1e9943a1987039494ecd76e9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:26.302957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971546d1e9943a1987039494ecd76e9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:26.308764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:26.416584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df391593-1059-4546-83a4-4fc90f2b03de None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:26.421301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971546d1e9943a1987039494ecd76e9', 'request_id': 'req-546cdd5a-959d-4ca5-ad2f-7108d551e139'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.440946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971546d1e9943a1987039494ecd76e9', 'request_id': 'req-546cdd5a-959d-4ca5-ad2f-7108d551e139'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.448758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971546d1e9943a1987039494ecd76e9', 'request_id': 'req-546cdd5a-959d-4ca5-ad2f-7108d551e139'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.463904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:26.482217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] The token cache is being invalidate because project b971546d1e9943a1987039494ecd76e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:26.482531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.483641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.486023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 931/1870] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:26 2022] DELETE /identity/v3/projects/b971546d1e9943a1987039494ecd76e9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:26.491333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:26.492928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.503359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:26.504215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:26.504501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:26.504859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:26.506874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.617154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cdd5a-959d-4ca5-ad2f-7108d551e139 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:26.618931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:26.620621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:26.627577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:26.628799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:26.630458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:26.631058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] PATH_INFO: `/v3/users/be7b743f422c416a92734c445d7e2fee` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:26.632723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7b743f422c416a92734c445d7e2fee)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:26.633819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 940/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:26.639121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:26.722231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7b743f422c416a92734c445d7e2fee'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.742483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:26.744197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:26.754773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7b743f422c416a92734c445d7e2fee'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.756671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7b743f422c416a92734c445d7e2fee'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.757630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7b743f422c416a92734c445d7e2fee'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.779000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7b743f422c416a92734c445d7e2fee'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:26.812234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 932/1872] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:26 2022] DELETE /identity/v3/users/be7b743f422c416a92734c445d7e2fee => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:26.869870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec0fba-607f-4161-9a27-6485461fc787 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:26.912607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:26.950574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:26.951445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:26.951990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:26.952368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:26.954945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:27.065669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:27.068221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:27.080614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 941/1873] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:27.607828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:27.609489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:27.637881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:27.639538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:27.748433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69141a3-96d1-4fdf-b568-3c447131eedf admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:27.757224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:27.758260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:27.758410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:27.758731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:27.761614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:27.783376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:27.785600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:27.794992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:27.802374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 933/1874] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:27.845966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:27.851139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:27.930996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4365-6309-44c9-8c25-86f8b6568d2a service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:27.950535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:27.951199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:27.951483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:27.951758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:27.961891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.003853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.005604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.060977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 942/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:28.062197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.069819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.139201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3956-b80b-4d06-bb09-5a6f1c07c278 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.155889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.156170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.156456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.156730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] PATH_INFO: `/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.180384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] RBAC: Authorizing `identity:delete_project(project_id=880d13a24a9949b9b2e64a2278f8f3dc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.183076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.338824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad6d17-f008-436b-83eb-5df8ee624386 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.346743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:28.351754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880d13a24a9949b9b2e64a2278f8f3dc', 'request_id': 'req-60e653a1-e2b7-411c-abb5-ca720281708e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.366270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880d13a24a9949b9b2e64a2278f8f3dc', 'request_id': 'req-60e653a1-e2b7-411c-abb5-ca720281708e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.376083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880d13a24a9949b9b2e64a2278f8f3dc', 'request_id': 'req-60e653a1-e2b7-411c-abb5-ca720281708e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.392600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] The token cache is being invalidate because project 880d13a24a9949b9b2e64a2278f8f3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:28.392954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.393717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.401178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 934/1876] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:27 2022] DELETE /identity/v3/projects/880d13a24a9949b9b2e64a2278f8f3dc => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:28.402149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.412262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.447685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.448740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.449193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.449661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] PATH_INFO: `/v3/projects/5e9b2389702445dab55dd13633837a7b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.451024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9b2389702445dab55dd13633837a7b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.453290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.512337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e653a1-e2b7-411c-abb5-ca720281708e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.522866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9b2389702445dab55dd13633837a7b', 'request_id': 'req-a816f500-dc52-4bd4-82b8-5ec6afb0235a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.537402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9b2389702445dab55dd13633837a7b', 'request_id': 'req-a816f500-dc52-4bd4-82b8-5ec6afb0235a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.546114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9b2389702445dab55dd13633837a7b', 'request_id': 'req-a816f500-dc52-4bd4-82b8-5ec6afb0235a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.556428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:28.559803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] The token cache is being invalidate because project 5e9b2389702445dab55dd13633837a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:28.560168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.561069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a816f500-dc52-4bd4-82b8-5ec6afb0235a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.563548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 943/1877] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:28 2022] DELETE /identity/v3/projects/5e9b2389702445dab55dd13633837a7b => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:28.565046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415b20-a300-474e-9d14-49840770595a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.565522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415b20-a300-474e-9d14-49840770595a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.565802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415b20-a300-474e-9d14-49840770595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.589433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-68415b20-a300-474e-9d14-49840770595a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:28.590738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-68415b20-a300-474e-9d14-49840770595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.592507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.593194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.593511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.593790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] PATH_INFO: `/v3/projects/916915b863764bc3a33d75f6ecfdf126` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.594969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916915b863764bc3a33d75f6ecfdf126)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.596895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.599652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 944/1878] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:28.600452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415b20-a300-474e-9d14-49840770595a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.602289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-68415b20-a300-474e-9d14-49840770595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.617736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415b20-a300-474e-9d14-49840770595a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.624146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.624875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.625604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.625893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] PATH_INFO: `/v3/users/3a9973d5846d457289e08ff44393f340` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.628350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9973d5846d457289e08ff44393f340)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.631262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.653626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916915b863764bc3a33d75f6ecfdf126', 'request_id': 'req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.665243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916915b863764bc3a33d75f6ecfdf126', 'request_id': 'req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.674338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916915b863764bc3a33d75f6ecfdf126', 'request_id': 'req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.693355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] The token cache is being invalidate because project 916915b863764bc3a33d75f6ecfdf126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:28.693946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.695070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a2724263-4b0b-4ab2-b260-b6b77aaf2c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.696982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 935/1879] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:28 2022] DELETE /identity/v3/projects/916915b863764bc3a33d75f6ecfdf126 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:28.701011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.701371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.701606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.704660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9973d5846d457289e08ff44393f340'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.715819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9973d5846d457289e08ff44393f340'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.716839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9973d5846d457289e08ff44393f340'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.724197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:28.724677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.735444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9973d5846d457289e08ff44393f340'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.736637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9973d5846d457289e08ff44393f340'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.765785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 945/1880] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:28 2022] DELETE /identity/v3/users/3a9973d5846d457289e08ff44393f340 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:28.765785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.766015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:28.775776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:28.828507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 936/1881] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:28.834125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.851712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01daa-f757-48f3-a825-088c45cef98f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.862647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2127-911b-4a1f-8948-e555584c52be admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.869638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.871150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.871326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.871465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.871465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.871639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.871803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.871936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:28.872250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.872391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] PATH_INFO: `/v3/users/2b21b6800c3b4cdd9957ecce089b177b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.874068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b21b6800c3b4cdd9957ecce089b177b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.875686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.877682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.911008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 937/1882] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:04:28.911653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:28.923457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65217fc-1e56-475f-bb0a-d3ac4f353414 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:28.929881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:28.930515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:28.931241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:28.931588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:28.932193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:28.944120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:28.976485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b21b6800c3b4cdd9957ecce089b177b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.992151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b21b6800c3b4cdd9957ecce089b177b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.992737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b21b6800c3b4cdd9957ecce089b177b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:28.995608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 938/1883] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:28 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:29.001150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.021920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b21b6800c3b4cdd9957ecce089b177b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.023493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b21b6800c3b4cdd9957ecce089b177b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.065218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 946/1884] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:28 2022] DELETE /identity/v3/users/2b21b6800c3b4cdd9957ecce089b177b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:29.090569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:29.136305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547baf-2453-46de-9d3f-1112dcb68440 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.220755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.221506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.221780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.222114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.222806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.227893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.255827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 939/1885] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:29.259625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.261570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.291521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0940dd-7a9f-4983-8307-0cf76f600018 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.297598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.298509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.299010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.299387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.300198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.302568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.323412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 947/1886] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:29.327374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.339123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84a98f-5b1f-4abd-9369-a12cf0035122 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.344955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.345715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.346296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.346411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.347309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.350615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.367283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 940/1887] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:29.368453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.382652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b3c7-fc22-418b-a665-d3a4bd9440b5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.388682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.389653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.389792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.390089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] PATH_INFO: `/v3/projects/0dbc98c3998e4d319b1bd5945c6a0dde/users/bcf71a52934a4746adcdb2524adddc71/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.405827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.407747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.419887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbc98c3998e4d319b1bd5945c6a0dde, user_id=bcf71a52934a4746adcdb2524adddc71, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.422954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d71aa-5655-465a-b13b-c5a132eeea51 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.429838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9375-87f0-4eb6-9ac4-f0f4beb873e3 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.437148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.440234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.441476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.443611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] PATH_INFO: `/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.447814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83b556ee7a845f7bf77fb2ceba0e83b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.450023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.452866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 948/1888] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:29 2022] PUT /identity/v3/projects/0dbc98c3998e4d319b1bd5945c6a0dde/users/bcf71a52934a4746adcdb2524adddc71/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:29.464788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edafe4-4d92-4f7c-8156-4c9e822b6424 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.465095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edafe4-4d92-4f7c-8156-4c9e822b6424 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.465427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edafe4-4d92-4f7c-8156-4c9e822b6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.507171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a7edafe4-4d92-4f7c-8156-4c9e822b6424 None None] MFA Rules not processed for user `bcf71a52934a4746adcdb2524adddc71`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:29.509064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a7edafe4-4d92-4f7c-8156-4c9e822b6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.535535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83b556ee7a845f7bf77fb2ceba0e83b', 'request_id': 'req-6e617809-8451-4345-a4e2-d3d6651d25bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.550964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83b556ee7a845f7bf77fb2ceba0e83b', 'request_id': 'req-6e617809-8451-4345-a4e2-d3d6651d25bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.561648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:29.564405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83b556ee7a845f7bf77fb2ceba0e83b', 'request_id': 'req-6e617809-8451-4345-a4e2-d3d6651d25bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.579277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] The token cache is being invalidate because project c83b556ee7a845f7bf77fb2ceba0e83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:29.579564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.580228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.581786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 941/1889] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:29 2022] DELETE /identity/v3/projects/c83b556ee7a845f7bf77fb2ceba0e83b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:29.582684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.583998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.597818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 949/1890] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:29.599776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.600063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.600340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.626408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:29.627627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.645665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:29.667916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e617809-8451-4345-a4e2-d3d6651d25bb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.676242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.677597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.678519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.678519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] PATH_INFO: `/v3/projects/ebbb249442254794bae3fef6d4403c94` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.680006 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbb249442254794bae3fef6d4403c94)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.682113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.695685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 950/1891] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:29.696608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.697929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.710646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd443ffe-df0d-443f-8433-a85ae3d3db21 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.716676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.717329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.717615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.717968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.718790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.720751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508c783-4d68-4b5c-acd1-9dce06f678fe admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.739478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbb249442254794bae3fef6d4403c94', 'request_id': 'req-37fccc46-ef76-4ec4-86a9-f812224866a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.747775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbb249442254794bae3fef6d4403c94', 'request_id': 'req-37fccc46-ef76-4ec4-86a9-f812224866a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.754683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 951/1892] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:29.754683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b755b-d1cf-42c7-b5da-bc974f753acf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.755488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b755b-d1cf-42c7-b5da-bc974f753acf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.755488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b755b-d1cf-42c7-b5da-bc974f753acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.758145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbb249442254794bae3fef6d4403c94', 'request_id': 'req-37fccc46-ef76-4ec4-86a9-f812224866a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.777177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-794b755b-d1cf-42c7-b5da-bc974f753acf None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:29.778499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-794b755b-d1cf-42c7-b5da-bc974f753acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.780817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] The token cache is being invalidate because project ebbb249442254794bae3fef6d4403c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:29.781233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.782054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:29.784092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 942/1893] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:29 2022] DELETE /identity/v3/projects/ebbb249442254794bae3fef6d4403c94 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:29.784641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.787454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.860100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fccc46-ef76-4ec4-86a9-f812224866a5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.864590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 952/1894] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:29.865158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.865833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.866112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.866385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.866655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.867053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.867216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.867626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.869399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.890652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:29.891873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.897858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 943/1895] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:29.897858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.900539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 953/1896] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:29.901363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.906141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f54d-d5f7-46bd-9e7f-c54828f4d072 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.911854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.912515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.912795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.913066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.913890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:29.914406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.914516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd71b2-591a-47fe-8a2e-1bd57685589e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.917168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea993-1148-4944-88e6-1f0eb6e37afb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.920203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.920823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.921109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.921417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.922112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.923691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.930859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 944/1897] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:29.931939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.932223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.932500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.934831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 954/1898] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:29.935771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.945879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f08b1-217a-40bc-b29c-122f7433102d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.951019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.951261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:29.951626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.951906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.952182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.952452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:29.952964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:29.954872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:29.961352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 945/1899] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:29.962095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.975469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ecb1d-5dfa-4cb0-a898-657f6103fcdc None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:29.981231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:29.982011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:29.982295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:29.982574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] PATH_INFO: `/v3/projects/a4ccdbbd80394934a039d9e80cdbb878/users/f09a9754a08248f3a7070a4bddb08bc6/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:29.992343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 955/1900] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:29 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:29.992343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:29.999350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ccdbbd80394934a039d9e80cdbb878, user_id=f09a9754a08248f3a7070a4bddb08bc6, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.002078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.008643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:30.025354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 946/1901] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:29 2022] PUT /identity/v3/projects/a4ccdbbd80394934a039d9e80cdbb878/users/f09a9754a08248f3a7070a4bddb08bc6/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:30.027354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.050495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:30.062037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f61b6-2e63-4d3c-b260-af3267820d63 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.103301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ba61-9d78-4afb-a9b8-54617b0f58fb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.108437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.109074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.109400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.109761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.110354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.112493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.142056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 947/1902] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:30 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:30.143082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.162989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419ed7-fa63-4a5e-9b63-00d036aa01e9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.172132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.172937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.173228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.174996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.177052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.177280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.178292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.178638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.179075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.179857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:30.180320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.180432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.182301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.198924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 956/1903] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:30.199977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.205715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 948/1904] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:30.206636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.212885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd69df-a725-49ca-9a76-695f7d713b9c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.219359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.220634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.220634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.220634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.221634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.223592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.229512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd9eb2-18a0-41a9-9bc6-0f33147634aa admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.238339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.238988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.240818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 957/1905] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:30.241851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.251839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.252098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.253086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.258028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d4b4e-d4da-4129-b9f2-d7cca267d089 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.262733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.263823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.264234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.264519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] PATH_INFO: `/v3/projects/a4ccdbbd80394934a039d9e80cdbb878/users/f09a9754a08248f3a7070a4bddb08bc6/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.264941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3824d1-5519-4378-acb7-2b20cf6dc9c2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.266731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ccdbbd80394934a039d9e80cdbb878, user_id=f09a9754a08248f3a7070a4bddb08bc6, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.269820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.283768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 958/1906] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:30 2022] PUT /identity/v3/projects/a4ccdbbd80394934a039d9e80cdbb878/users/f09a9754a08248f3a7070a4bddb08bc6/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:30.284582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.307454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 949/1907] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:30 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:30.308945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.309237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.309654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.344553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] MFA Rules not processed for user `f09a9754a08248f3a7070a4bddb08bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:30.346173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:30.432028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587672-1e72-471a-ad3c-3e60fe651b0e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.484852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:30.530811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.531499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.531899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.532345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.533391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.535614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.541200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 950/1908] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:30.542478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.571544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e838d-066a-428a-8d38-b5d4699a8dd5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.572804 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 959/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:30.573441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.575623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:30.585327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.587773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.588636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.589121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.591392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.597058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.648274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 951/1910] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:30 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:30.649775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.665748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4dd3-7a6b-408a-a531-5a1bb4cc4d4e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.673164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.674137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.674558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.674840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] PATH_INFO: `/v3/projects/9d79103848e241af85d0e04cdf0dee11/users/505490c842d5453ba968636332b0aafa/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.699294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d79103848e241af85d0e04cdf0dee11, user_id=505490c842d5453ba968636332b0aafa, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.708456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.710977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba933afc-31a0-4dca-b287-867a4967f7fe admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.716407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.717099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.717572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.717884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.741121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.742273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 952/1911] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:30 2022] PUT /identity/v3/projects/9d79103848e241af85d0e04cdf0dee11/users/505490c842d5453ba968636332b0aafa/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:30.746656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e04c52-9c62-45e9-b6c5-09716a2eedea service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.746987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:30.809238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 960/1912] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:30.814021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:30.816584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.819388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.820326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.922009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] MFA Rules not processed for user `505490c842d5453ba968636332b0aafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:30.923243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:30.941554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989ecb-0603-43ac-af67-bd67fa59907d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:30.953393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:30.954241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:30.954745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:30.954941 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:30.955676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:30.957588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:30.987692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 953/1913] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:30.990148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.013204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002a63-935d-431a-b0cc-3a4fdbac97ce admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.020392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.022098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.023153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.023553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.025663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.027737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.049754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 954/1914] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:31.054116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.076488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7bee1-65cf-46d8-a8e9-c241ab7ebacd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.083609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.084385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.084687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.084969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] PATH_INFO: `/v3/projects/e6c7cc01f8674cf8880a4e4805870b22/users/37d3303e3c3f47269fe79c3b1c68b59f/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.117931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 961/1915] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:31.122731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.138358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9df0-1d69-4a6d-9156-c8add5e30081 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.140297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c7cc01f8674cf8880a4e4805870b22, user_id=37d3303e3c3f47269fe79c3b1c68b59f, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.144988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.145737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.146026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.146305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.146983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.148891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.150768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab81fe-5cf1-4043-8ee2-33927fc0c884 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.193313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 955/1916] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:31 2022] PUT /identity/v3/projects/e6c7cc01f8674cf8880a4e4805870b22/users/37d3303e3c3f47269fe79c3b1c68b59f/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:31.200305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.200807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.201086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.208779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 962/1917] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:31.212369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.293996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] MFA Rules not processed for user `37d3303e3c3f47269fe79c3b1c68b59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:31.300061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:31.331328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:31.373226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c95bb-2099-4415-91ef-45e03613a063 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.390892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.391549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.394003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.394323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.400026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.403436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.489360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 963/1918] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:31.492419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.501170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 956/1919] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:31.502143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.519222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca70173-c37c-4f21-a983-b299aa83bde6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.532374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.533017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.533315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.533918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.534134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf245-6e4f-4e06-8e47-cd7625b78390 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.534777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.536964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.540371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.541082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.541463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.541745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.542731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.545180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.566460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 964/1920] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:31.571447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.587853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f390e8-0059-44f4-bf49-4b07f05fb66c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.607844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.608593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.608882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.609159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] PATH_INFO: `/v3/projects/670bfa1de3d74edeb0fe57650a8ab292/users/45ca6bda23c940f4b584a641ecd35652/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.614071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 957/1921] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:31.614071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.634908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] RBAC: Authorizing `identity:create_grant(project_id=670bfa1de3d74edeb0fe57650a8ab292, user_id=45ca6bda23c940f4b584a641ecd35652, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.648181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.696092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 965/1922] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:31 2022] PUT /identity/v3/projects/670bfa1de3d74edeb0fe57650a8ab292/users/45ca6bda23c940f4b584a641ecd35652/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:31.697331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.735521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:31.757590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f216c-387c-4d2d-888e-99a1dcf27b56 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.806760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4e8a-d725-4b5c-9d51-8dacd776257f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.812930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.815188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.815589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.815973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.818012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.820674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.855943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 966/1923] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:31.857299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.870811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09a9754a08248f3a7070a4bddb08bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ccdbbd80394934a039d9e80cdbb878', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.871496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.871786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.872075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.872911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:31.873232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.875029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.890703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 958/1924] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:31.891450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.892044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb18b7-6e72-40e8-a2ca-32c5369e4bd4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.903634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4445f4-f35f-4244-8729-3151e9af12c7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.906632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.907292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.907691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.908071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.909089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.909292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.909885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.910170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.910448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.910862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.911170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.912915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.923206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 967/1925] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:31.925429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 959/1926] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:31.925563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.927632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:31.938474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94285fc-e826-484d-b8fb-29879b453345 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.942821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fa7a3-bb41-40bb-b1fb-43c15ef11ff2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:31.946507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09a9754a08248f3a7070a4bddb08bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ccdbbd80394934a039d9e80cdbb878', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.947670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.948049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.948554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.949940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.952456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135f5fa-046b-4e28-b2bd-787bd6271ae8 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.953228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:31.954424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:31.954715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:31.955003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] PATH_INFO: `/v3/projects/670bfa1de3d74edeb0fe57650a8ab292/users/45ca6bda23c940f4b584a641ecd35652/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:31.959498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670bfa1de3d74edeb0fe57650a8ab292, user_id=45ca6bda23c940f4b584a641ecd35652, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:31.963015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:31.993349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 960/1927] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:31 2022] PUT /identity/v3/projects/670bfa1de3d74edeb0fe57650a8ab292/users/45ca6bda23c940f4b584a641ecd35652/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:31.994600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.008921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 968/1928] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:32.008921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.008921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.008921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.051320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] MFA Rules not processed for user `45ca6bda23c940f4b584a641ecd35652`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:32.053005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:32.086681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c530c-46ed-44d1-8c3a-380679fb3f30 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.122268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:32.156899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 969/1929] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:32.156899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.160542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.161534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.161831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.162109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] PATH_INFO: `/v3/projects/07d089553b8e483faffe5bdaec1541b0/users/a1c404776c2f4f47b922d23cc3a48632/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.188018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d089553b8e483faffe5bdaec1541b0, user_id=a1c404776c2f4f47b922d23cc3a48632, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.193186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.196445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:32.246052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 961/1930] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:31 2022] PUT /identity/v3/projects/07d089553b8e483faffe5bdaec1541b0/users/a1c404776c2f4f47b922d23cc3a48632/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:32.246851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.269015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e961fb-e8ec-45c8-ba9b-1d20affd81a3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.348249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980b83-6085-49f6-909d-96a8a55b8e58 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.353168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f753-a860-4132-a814-08942707521e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.353958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f753-a860-4132-a814-08942707521e service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.354243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f753-a860-4132-a814-08942707521e service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.354617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f753-a860-4132-a814-08942707521e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.362973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09a9754a08248f3a7070a4bddb08bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ccdbbd80394934a039d9e80cdbb878', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.363628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.363929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.364843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.365882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:32.366199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.372367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.404805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 970/1931] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:32.404805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.508591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f753-a860-4132-a814-08942707521e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.512309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2487-6d4b-4d51-ac28-986e130d66a7 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.512703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f753-a860-4132-a814-08942707521e service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.527957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.529156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.530186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.530547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.532367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.536502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.538838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 962/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:32.541926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f753-a860-4132-a814-08942707521e service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.569990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 971/1933] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:32.574148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.574312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f753-a860-4132-a814-08942707521e service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.591039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09a9754a08248f3a7070a4bddb08bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ccdbbd80394934a039d9e80cdbb878', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.591715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.599061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.599369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] PATH_INFO: `/v3/projects/37ded09d2d4841ed9c1c40f9497dc6af` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.601705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405bde-1bb1-4a3d-994c-5af749d7c571 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:32.605992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37ded09d2d4841ed9c1c40f9497dc6af)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.608495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.627015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:32.627726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.628012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.628297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] PATH_INFO: `/v3/projects/07d089553b8e483faffe5bdaec1541b0/users/a1c404776c2f4f47b922d23cc3a48632/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.637169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d089553b8e483faffe5bdaec1541b0, user_id=a1c404776c2f4f47b922d23cc3a48632, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:32.639894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6a959-ef98-4efc-83b5-1ba7afdfeb03 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:32.681209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 972/1934] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:32 2022] PUT /identity/v3/projects/07d089553b8e483faffe5bdaec1541b0/users/a1c404776c2f4f47b922d23cc3a48632/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:32.682871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:32.683164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:32.683443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:32.708186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:32.724937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ded09d2d4841ed9c1c40f9497dc6af', 'request_id': 'req-38749da6-ffad-4867-940d-25edfe5a43c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:32.740143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] MFA Rules not processed for user `a1c404776c2f4f47b922d23cc3a48632`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:32.740498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ded09d2d4841ed9c1c40f9497dc6af', 'request_id': 'req-38749da6-ffad-4867-940d-25edfe5a43c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:32.743866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:32.754629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ded09d2d4841ed9c1c40f9497dc6af', 'request_id': 'req-38749da6-ffad-4867-940d-25edfe5a43c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:32.769923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] The token cache is being invalidate because project 37ded09d2d4841ed9c1c40f9497dc6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:32.770754 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:32.774244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:32.776242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 963/1935] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:32 2022] DELETE /identity/v3/projects/37ded09d2d4841ed9c1c40f9497dc6af => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:32.956833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 973/1936] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:32.990912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:32.992938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:33.062440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:33.128255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749da6-ffad-4867-940d-25edfe5a43c3 tempest-VolumeQuotaClassesTest-1952356498 tempest-VolumeQuotaClassesTest-1952356498-project-admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:33.137932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:33.139976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:33.140492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:33.141176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:33.154570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:33.156961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:33.177757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 964/1937] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:33.278816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:33.281000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:33.451087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed84a96-891c-4ab2-b883-34a4298516a5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:33.464994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:33.465744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:33.466035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:33.466313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] PATH_INFO: `/v3/users/bcf71a52934a4746adcdb2524adddc71` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:33.469213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf71a52934a4746adcdb2524adddc71)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:33.471541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:33.593391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf71a52934a4746adcdb2524adddc71'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:33.612877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf71a52934a4746adcdb2524adddc71'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:33.615156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf71a52934a4746adcdb2524adddc71'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:33.661124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf71a52934a4746adcdb2524adddc71'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:33.664160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bf759e64-7ab5-4a2a-8e9a-5c3a0820f604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf71a52934a4746adcdb2524adddc71'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:33.673358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:33.686784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d94a4-c277-4626-9586-2ea0f4767ff8 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:33.700033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:33.701751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:33.703321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:33.703875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:33.706983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 974/1938] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:33 2022] DELETE /identity/v3/users/bcf71a52934a4746adcdb2524adddc71 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:33.709656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:33.711671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:33.713521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:33.714130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:33.774304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:33.777497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:33.795066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:33.930917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 975/1939] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:34.015168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:34.023805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:34.024495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:34.026646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:34.056849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 965/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:34.128484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:34.130732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:34.158947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859f11-ed18-4bd7-8e40-1fd914ac434d service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:34.174506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:34.175182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:34.175471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:34.179047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] PATH_INFO: `/v3/users/505490c842d5453ba968636332b0aafa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:34.182681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505490c842d5453ba968636332b0aafa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:34.189820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:34.221166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8ffc-ab77-45bc-bc05-63bb5dbf5a00 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:34.233024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:34.235282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:34.237031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:34.237524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:34.266824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:34.281819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758e2c-4eee-471a-99d4-3ae909d602f8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:34.319465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 976/1941] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:34.327237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505490c842d5453ba968636332b0aafa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:34.338248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505490c842d5453ba968636332b0aafa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:34.339244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505490c842d5453ba968636332b0aafa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:34.339998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505490c842d5453ba968636332b0aafa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:34.357498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505490c842d5453ba968636332b0aafa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:34.376972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 966/1942] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:34 2022] DELETE /identity/v3/users/505490c842d5453ba968636332b0aafa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:34.381718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754e80-aaca-4ba2-8eb2-956c7104d1b6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:34.382238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754e80-aaca-4ba2-8eb2-956c7104d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:34.382712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754e80-aaca-4ba2-8eb2-956c7104d1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:34.405989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3b754e80-aaca-4ba2-8eb2-956c7104d1b6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:34.407324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3b754e80-aaca-4ba2-8eb2-956c7104d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:34.482027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 977/1943] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:34.541362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:34.543263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:34.648945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:34.672016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd4c5-ca01-447f-aace-a275f556db26 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:34.679031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:34.680354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:34.680644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:34.682427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:34.695802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:34.700203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6de374-c6d7-4134-b5f5-a98d4594803c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:34.724426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 967/1944] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:35.534194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:35.534772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:35.535051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:35.537450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 978/1945] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:04:35.548920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:35.549947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:35.550427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:35.578083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:35.579866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:35.740061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 968/1946] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:35.762958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:35.767367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:35.805918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47dcc-b8a3-4924-bba5-ee8401bdd164 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:35.824048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:35.825942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:35.827161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:35.827553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:35.880849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:35.880849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:35.887128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 979/1947] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:35.903728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:35.905627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:35.954446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76919-d212-4e01-8461-411bbc98cf86 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:35.965307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:35.991623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:35.993731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:35.997104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] PATH_INFO: `/v3/projects/0dbc98c3998e4d319b1bd5945c6a0dde` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:36.002146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbc98c3998e4d319b1bd5945c6a0dde)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:36.005775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:36.125427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbc98c3998e4d319b1bd5945c6a0dde', 'request_id': 'req-347af153-f96a-496d-98f0-61000ed0bfca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.161054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbc98c3998e4d319b1bd5945c6a0dde', 'request_id': 'req-347af153-f96a-496d-98f0-61000ed0bfca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.173114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbc98c3998e4d319b1bd5945c6a0dde', 'request_id': 'req-347af153-f96a-496d-98f0-61000ed0bfca'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.191104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] The token cache is being invalidate because project 0dbc98c3998e4d319b1bd5945c6a0dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:36.191372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.194241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.195971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 969/1948] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:35 2022] DELETE /identity/v3/projects/0dbc98c3998e4d319b1bd5945c6a0dde => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:36.199962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:36.216224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ab8f9-c7bc-4f91-8c1b-03f258cb2844 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:36.216903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:36.219062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:36.267998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:36.289201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:36.290924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:36.290924 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:36.291431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] PATH_INFO: `/v3/users/f09a9754a08248f3a7070a4bddb08bc6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:36.293425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09a9754a08248f3a7070a4bddb08bc6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:36.296554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:36.329131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:36.334088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af153-f96a-496d-98f0-61000ed0bfca admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:36.338990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:36.339701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:36.339989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:36.340356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] PATH_INFO: `/v3/projects/9d79103848e241af85d0e04cdf0dee11` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:36.342116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d79103848e241af85d0e04cdf0dee11)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:36.344110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:36.366017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09a9754a08248f3a7070a4bddb08bc6'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.374022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09a9754a08248f3a7070a4bddb08bc6'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.374766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09a9754a08248f3a7070a4bddb08bc6'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.387538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09a9754a08248f3a7070a4bddb08bc6'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.389904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09a9754a08248f3a7070a4bddb08bc6'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.397602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d79103848e241af85d0e04cdf0dee11', 'request_id': 'req-c8a381db-eb77-40a8-9607-b732e8c04e03'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.404825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 980/1949] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:36 2022] DELETE /identity/v3/users/f09a9754a08248f3a7070a4bddb08bc6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:36.407527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d79103848e241af85d0e04cdf0dee11', 'request_id': 'req-c8a381db-eb77-40a8-9607-b732e8c04e03'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.415955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d79103848e241af85d0e04cdf0dee11', 'request_id': 'req-c8a381db-eb77-40a8-9607-b732e8c04e03'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.428423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] The token cache is being invalidate because project 9d79103848e241af85d0e04cdf0dee11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:36.428718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.429432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.433803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 970/1950] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:36 2022] DELETE /identity/v3/projects/9d79103848e241af85d0e04cdf0dee11 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:36.435217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:36.437079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:36.534714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dfad5-c840-4f2b-bb7f-93229bdf7563 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:36.541540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:36.542489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:36.543270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:36.543665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] PATH_INFO: `/v3/users/45ca6bda23c940f4b584a641ecd35652` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:36.546292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ca6bda23c940f4b584a641ecd35652)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:36.549116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:36.670757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ca6bda23c940f4b584a641ecd35652'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.690133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ca6bda23c940f4b584a641ecd35652'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.692658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ca6bda23c940f4b584a641ecd35652'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.711580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:36.719576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ca6bda23c940f4b584a641ecd35652'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.720764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ca6bda23c940f4b584a641ecd35652'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:36.740274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 981/1951] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:36 2022] DELETE /identity/v3/users/45ca6bda23c940f4b584a641ecd35652 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:36.760932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:36.762533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:36.911855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a381db-eb77-40a8-9607-b732e8c04e03 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:36.983254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:36.983839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:36.984128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:36.984523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] PATH_INFO: `/v3/projects/a4ccdbbd80394934a039d9e80cdbb878` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:36.985756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ccdbbd80394934a039d9e80cdbb878)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:36.987733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.037554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:37.053730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ccdbbd80394934a039d9e80cdbb878', 'request_id': 'req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.064363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ccdbbd80394934a039d9e80cdbb878', 'request_id': 'req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.073767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ccdbbd80394934a039d9e80cdbb878', 'request_id': 'req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.081751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.083248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.090015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] The token cache is being invalidate because project a4ccdbbd80394934a039d9e80cdbb878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:37.090521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.091770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4c351d35-518a-4ffb-8e2a-2a38741ab8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.093402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 971/1952] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:36 2022] DELETE /identity/v3/projects/a4ccdbbd80394934a039d9e80cdbb878 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:37.098958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.099246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.099523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.105151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac2fb8-10cb-4871-8c9c-ffa07a2e1535 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.122385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:37.123622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.183887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.184548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.184857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.185142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] PATH_INFO: `/v3/projects/670bfa1de3d74edeb0fe57650a8ab292` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.186335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670bfa1de3d74edeb0fe57650a8ab292)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.188264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.202032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 972/1953] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:37.202970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.204350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.222421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d45932-7a7d-465e-89d9-e229a6150cc9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.227886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.228610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.228910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.229190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] PATH_INFO: `/v3/users/37d3303e3c3f47269fe79c3b1c68b59f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.230415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d3303e3c3f47269fe79c3b1c68b59f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.232354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.238588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670bfa1de3d74edeb0fe57650a8ab292', 'request_id': 'req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.245996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670bfa1de3d74edeb0fe57650a8ab292', 'request_id': 'req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.251771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670bfa1de3d74edeb0fe57650a8ab292', 'request_id': 'req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.263233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] The token cache is being invalidate because project 670bfa1de3d74edeb0fe57650a8ab292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:37.263523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.264361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96b4e9de-7e6d-4e25-99c9-bc3cc430db08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.265813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 982/1954] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:37 2022] DELETE /identity/v3/projects/670bfa1de3d74edeb0fe57650a8ab292 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:37.267002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418bd2-8312-41d0-b026-025495631419 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.267290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418bd2-8312-41d0-b026-025495631419 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.267570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418bd2-8312-41d0-b026-025495631419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.282723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d3303e3c3f47269fe79c3b1c68b59f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.288767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-16418bd2-8312-41d0-b026-025495631419 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:37.290122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-16418bd2-8312-41d0-b026-025495631419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.290522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d3303e3c3f47269fe79c3b1c68b59f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.291206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d3303e3c3f47269fe79c3b1c68b59f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.291865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d3303e3c3f47269fe79c3b1c68b59f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.305038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4b4abba8-efe6-4b6d-80e9-1a2bcb1eedf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d3303e3c3f47269fe79c3b1c68b59f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:37.317813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 973/1955] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:37 2022] DELETE /identity/v3/users/37d3303e3c3f47269fe79c3b1c68b59f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:37.319142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.319431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.319709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.340219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:37.341579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.353328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 983/1956] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:37.354820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1981dd-ab17-4abe-b718-0e80c924e4fd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.355256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1981dd-ab17-4abe-b718-0e80c924e4fd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.358044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1981dd-ab17-4abe-b718-0e80c924e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.380234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cb1981dd-ab17-4abe-b718-0e80c924e4fd None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:37.381564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cb1981dd-ab17-4abe-b718-0e80c924e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.387481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:37.416934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:37.451167 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 974/1957] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:37.452035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.465402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2796232-0e62-4c2e-ac06-0016613097da None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.470242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 984/1958] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:37.471595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.471886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.472166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.475179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.475838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.476132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.476413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.477855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:37.478161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.479938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.498934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:37.498934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.499550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 975/1959] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:37.500501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.502142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:37.507025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 985/1960] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:37.507740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.519832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e6af-6f9b-4222-ad79-76ebf9f48e89 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.525701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.526782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.527069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.527347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.528414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.530693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.570125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 986/1961] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:37.570982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.574868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4fd1-af02-43a5-a524-552d4d7eb880 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.655019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.656047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.657820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.658701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.683559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d519b5-1300-4946-b865-866cdc87898e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.698038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.698706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.698996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.699269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.700263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:37.700587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.702235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.735231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 987/1962] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:37.735231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.757206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36931f-556e-44f2-b4b3-dc1fa2357514 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.772182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.773147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.773728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.774209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.775057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.777176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.779995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.782232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.795791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 976/1963] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:37.807202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 988/1964] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/users => generated 286 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:37.808322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.812718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.834326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b69067-b6b4-4c86-94e1-dea0b1423537 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.838901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3def6c-d0b7-4f9f-893a-aa5f49d93b29 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.841013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.842212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.842968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.843482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.844650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.850315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.861747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:37.862433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:37.865787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:37.866112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:37.866857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:37.868519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:37.896116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 977/1965] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:37.898099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.899137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 989/1966] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:37.904365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:37.910711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ea85-70fd-4af1-b438-616c7598df71 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:37.936132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:38.016383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:38.031947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.032597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.032888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.033171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.035840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.040465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.058678 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 978/1967] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:38.059872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.065800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e64d-bd40-410a-aab6-cb341fe0314e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.072458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65c33-90e5-4de1-bf4e-53c3a6efd516 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.078382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.078564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.079468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.079626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.079887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.080338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.080453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] PATH_INFO: `/v3/projects/22558a8d8b0f440fa7b8ef618a457560/users/2313edf687ee43eeaa2d0f536a4690f9/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.082577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.085016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.090711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.098053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22558a8d8b0f440fa7b8ef618a457560, user_id=2313edf687ee43eeaa2d0f536a4690f9, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.101295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e15bbf-c172-48da-a549-aea7dc84d201 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.129138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 979/1968] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:38 2022] PUT /identity/v3/projects/22558a8d8b0f440fa7b8ef618a457560/users/2313edf687ee43eeaa2d0f536a4690f9/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:38.135765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.136155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.137177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.147594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 990/1969] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:37 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:38.152403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.193907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:38.195660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:38.200757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8121d-bca4-4302-ac6e-6bb223a0fd05 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.374919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.375700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.376139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.377336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.378976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.382801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.391840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 980/1970] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:38.416095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 991/1971] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:38.419736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.436702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5557b-ea20-4710-a964-83730c83baf0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.438355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.443313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:38.448179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.449396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.449761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.450193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.451214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.452979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.469198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 981/1972] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:38.472743 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.487378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9521-f6df-41f8-b63e-e5ce17bff6cb admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.493402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.494104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.494392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.494720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] PATH_INFO: `/v3/projects/9ee0a1793da642e6b51a054e1392c90d/users/81960d89f2204a72b1a96db85a35e7e7/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.515737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee0a1793da642e6b51a054e1392c90d, user_id=81960d89f2204a72b1a96db85a35e7e7, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.518581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01568efb-c7f7-447c-bc2c-8c32a0e00c04 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.554675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 982/1973] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:38 2022] PUT /identity/v3/projects/9ee0a1793da642e6b51a054e1392c90d/users/81960d89f2204a72b1a96db85a35e7e7/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:38.566903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.567127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.567409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.583936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88392f-5cf5-433e-a10c-e492bf115a0b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.608868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] MFA Rules not processed for user `81960d89f2204a72b1a96db85a35e7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:38.611203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:38.718343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.719336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.719806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.720269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.737906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:38.781151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 983/1974] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:38.796143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:38.799767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:38.802942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:38.883148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.884633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:38.918266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 992/1975] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:38.929488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342080f1-9cf8-4e05-aa02-1264647a938c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:38.933424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:38.934285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:38.934570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:38.935224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:38.976108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:38.984182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:39.005536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 984/1976] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:39.127772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:39.129751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:39.157360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d1d77-1572-4037-ae3e-09a6a2ca559d service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:39.166512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:39.167205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:39.167570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:39.167765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] PATH_INFO: `/v3/projects/e6c7cc01f8674cf8880a4e4805870b22` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:39.173923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c7cc01f8674cf8880a4e4805870b22)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:39.176674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:39.338479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c7cc01f8674cf8880a4e4805870b22', 'request_id': 'req-c61be128-27ce-4e8c-81cb-08b7d6d31b78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.354875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c7cc01f8674cf8880a4e4805870b22', 'request_id': 'req-c61be128-27ce-4e8c-81cb-08b7d6d31b78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.399092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c7cc01f8674cf8880a4e4805870b22', 'request_id': 'req-c61be128-27ce-4e8c-81cb-08b7d6d31b78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.472527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] The token cache is being invalidate because project e6c7cc01f8674cf8880a4e4805870b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:39.472841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.486314 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.494584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 993/1977] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:39 2022] DELETE /identity/v3/projects/e6c7cc01f8674cf8880a4e4805870b22 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:39.498332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:39.515777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b13bbe-2cf0-4aef-89b0-d0e915d5ab2f service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:39.648014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:39.649104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:39.649613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:39.650098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] PATH_INFO: `/v3/users/a1c404776c2f4f47b922d23cc3a48632` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:39.651992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c404776c2f4f47b922d23cc3a48632)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:39.654447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:39.735141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c404776c2f4f47b922d23cc3a48632'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.748604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c404776c2f4f47b922d23cc3a48632'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.749886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c404776c2f4f47b922d23cc3a48632'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.750764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c404776c2f4f47b922d23cc3a48632'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.766181 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-56b0233f-6123-4317-ad50-1442cfcaf95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c404776c2f4f47b922d23cc3a48632'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:39.786263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 985/1978] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:39 2022] DELETE /identity/v3/users/a1c404776c2f4f47b922d23cc3a48632 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:40.248360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.251022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:40.269687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be128-27ce-4e8c-81cb-08b7d6d31b78 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.355101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.355771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.356057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.356335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] PATH_INFO: `/v3/projects/07d089553b8e483faffe5bdaec1541b0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.357589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d089553b8e483faffe5bdaec1541b0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.359527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.416172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d089553b8e483faffe5bdaec1541b0', 'request_id': 'req-d988e506-3287-401f-937d-c2d65c2fcdbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:40.421728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:40.427265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d089553b8e483faffe5bdaec1541b0', 'request_id': 'req-d988e506-3287-401f-937d-c2d65c2fcdbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:40.435761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d089553b8e483faffe5bdaec1541b0', 'request_id': 'req-d988e506-3287-401f-937d-c2d65c2fcdbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:40.447886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] The token cache is being invalidate because project 07d089553b8e483faffe5bdaec1541b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:40.448181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:40.448940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d988e506-3287-401f-937d-c2d65c2fcdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:40.450559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 994/1979] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:40 2022] DELETE /identity/v3/projects/07d089553b8e483faffe5bdaec1541b0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:40.455438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.455733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.456015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.477253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:40.478469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:40.482981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:40.566518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 986/1980] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:40.567246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.567246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.567246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.579599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:40.580945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:40.590636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 995/1981] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:40.594926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.608275 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491eae-f1ac-4646-9cdc-4bfdaad2249b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.614716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.615602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.616064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.616528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.617450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:40.617968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.620125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.650396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 987/1982] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:40.654430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.667543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc0a86-ea97-4c0d-a310-e8daa6753254 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.672324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.673048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.673439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.673788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.674679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.676836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fbc0a-f293-4a2a-8da5-22d0deeafbd3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.724702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 996/1983] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:40.728671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.739349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a60590-f04d-4fff-bfb8-886d23fe7065 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.800656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.801021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.801442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.845697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.847190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.847650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.848128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.849228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.849546 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] MFA Rules not processed for user `2313edf687ee43eeaa2d0f536a4690f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:40.852175 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:40.852669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.898122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 988/1984] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:40.902106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.915403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a16dd2-4d4f-4790-b9f5-21d72db6e3f0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.921078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.922118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.922610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.923373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.924304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.926765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.945037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 989/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:40.948131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 997/1986] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:40.949711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.952283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:40.955258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:40.971152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917dd1e-37dc-4197-93c8-09f3532d363f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.972523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5658-8017-46a8-bf04-ba7de403a9d9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:40.977046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.977735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.978020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.978321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.979003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.979396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:40.980478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:40.980946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:40.981360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:40.981664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:40.982729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:40.985947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.000137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 990/1987] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:41.005201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.021640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6ebd-0afd-4983-be03-7b4eceb46f20 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.021836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 998/1988] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:41.023217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.108906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.109929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.110218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.110498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] PATH_INFO: `/v3/projects/f8e636f5b1f740a8a89f63bab146b67d/users/22a867b6e8a04b32b8a2bbebbd3a74be/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.122242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:41.141194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e636f5b1f740a8a89f63bab146b67d, user_id=22a867b6e8a04b32b8a2bbebbd3a74be, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.145379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf899ec-f4cd-42c7-a85e-23105ed382d1 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.164695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d591-4fae-4a91-a741-399fd887151a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.173580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 991/1989] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:41 2022] PUT /identity/v3/projects/f8e636f5b1f740a8a89f63bab146b67d/users/22a867b6e8a04b32b8a2bbebbd3a74be/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:41.185574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.186302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.186593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.198380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:41.244718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.245456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.245864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.246074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.248276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.250714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.266416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] MFA Rules not processed for user `22a867b6e8a04b32b8a2bbebbd3a74be`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:41.268063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:41.289778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 999/1990] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:41 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:41.289778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.303781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57180d6-fc8a-4a2a-bff9-40a28a91e067 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.311416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.312172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.312900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.312900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.313735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.316256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.337719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1000/1991] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:41.343492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.372236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f955-545d-481b-9304-52d0344292f7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.385805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.387499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.387855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.389420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] PATH_INFO: `/v3/projects/9cc5018a45484c2582d4860e77f29de1/users/64311bf8ebbf460fa0b8f47c0d9e0401/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.415588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 992/1992] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:41.428328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.430296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:41.435634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5018a45484c2582d4860e77f29de1, user_id=64311bf8ebbf460fa0b8f47c0d9e0401, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.439123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.456509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1001/1993] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:41 2022] PUT /identity/v3/projects/9cc5018a45484c2582d4860e77f29de1/users/64311bf8ebbf460fa0b8f47c0d9e0401/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:41.460783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.534295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe350d5-997d-4497-91ba-41e946e20fb4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.542699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316316dc-1629-480e-b03b-b39d7dac5ba3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.548557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.549548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.549843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.550129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.550855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.553092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.565360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1002/1994] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:41.570256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:41.583759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44b1e9-8e37-411b-ac24-c7546c4ef4e8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:41.590292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.591053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:41.591607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.591721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:41.591953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.592152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:41.592260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.592960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] PATH_INFO: `/v3/projects/9cc5018a45484c2582d4860e77f29de1/users/64311bf8ebbf460fa0b8f47c0d9e0401/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:41.594837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5018a45484c2582d4860e77f29de1, user_id=64311bf8ebbf460fa0b8f47c0d9e0401, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.600795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.619204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1003/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:41 2022] PUT /identity/v3/projects/9cc5018a45484c2582d4860e77f29de1/users/64311bf8ebbf460fa0b8f47c0d9e0401/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:41.633811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:41.677825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:41.679497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177e8b8-0ca5-45ce-a492-6e31fcf87269 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:41.689204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 993/1996] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:42.431759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:42.433571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:42.565176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766212f9-53db-41f1-b795-7292d2cbed8e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:42.572560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:42.573435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:42.573778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:42.574132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] PATH_INFO: `/v3/users/e05746a92b374a69ad3c08b57acd1b1e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:42.575447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05746a92b374a69ad3c08b57acd1b1e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:42.577759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:42.584840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:42.647379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05746a92b374a69ad3c08b57acd1b1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:42.656034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05746a92b374a69ad3c08b57acd1b1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:42.656713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05746a92b374a69ad3c08b57acd1b1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:42.672716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05746a92b374a69ad3c08b57acd1b1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:42.673919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-81d64ff6-d045-4d0e-bb32-d2461d03a43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05746a92b374a69ad3c08b57acd1b1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:42.688954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1004/1997] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:42 2022] DELETE /identity/v3/users/e05746a92b374a69ad3c08b57acd1b1e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:42.695865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:42.696322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:42.696417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:42.722210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:42.723468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:42.836929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 994/1998] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:42.846991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:42.847286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:42.847570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:42.871184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:42.876368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:42.932791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] MFA Rules not processed for user `64311bf8ebbf460fa0b8f47c0d9e0401`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:42.934211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:42.965035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7607a0-394e-4f7d-b5e2-3a986896dc44 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:42.969855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:42.971099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:42.973469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:42.974198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:42.989057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:42.990844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f7a54-3502-42ce-98d4-740f21ae4e10 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:43.006850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 995/1999] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:43.089043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1005/2000] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:43.100022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:43.100329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:43.100608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:43.130688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] MFA Rules not processed for user `2313edf687ee43eeaa2d0f536a4690f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:43.132170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:43.235662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 996/2001] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:43.236502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:43.238082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:43.366884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5e1d-f620-4c49-a0bb-8e1d6b599375 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:43.372965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:43.373647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:43.373937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:43.374219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:43.376832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:43.386934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:43.389227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:43.391131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:43.411055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1006/2002] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:43.555112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:43.556863 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:43.574076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6f1be-1fc3-472d-b0a1-1fafa01584dd None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:43.580282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:43.580769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:43.581615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:43.581778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] PATH_INFO: `/v3/projects/b39915bef2694413a2d1c8ec2c070141` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:43.583734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39915bef2694413a2d1c8ec2c070141)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:43.586053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:43.598767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:43.665121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39915bef2694413a2d1c8ec2c070141', 'request_id': 'req-38c60c3c-8e21-46e3-8aed-0dcac91e7771'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.675549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39915bef2694413a2d1c8ec2c070141', 'request_id': 'req-38c60c3c-8e21-46e3-8aed-0dcac91e7771'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.684961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39915bef2694413a2d1c8ec2c070141', 'request_id': 'req-38c60c3c-8e21-46e3-8aed-0dcac91e7771'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.701305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] The token cache is being invalidate because project b39915bef2694413a2d1c8ec2c070141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:43.701305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.703478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.708876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 997/2003] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:43 2022] DELETE /identity/v3/projects/b39915bef2694413a2d1c8ec2c070141 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:43.710442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:43.725625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deac4a-8385-4e3c-a0eb-16f0458de30a service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:43.820222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:43.821082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:43.821539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:43.821913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] PATH_INFO: `/v3/users/a9b3ceca031a485db038587e43bda4ff` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:43.823251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b3ceca031a485db038587e43bda4ff)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:43.827776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:43.895395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b3ceca031a485db038587e43bda4ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.903972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b3ceca031a485db038587e43bda4ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.905186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b3ceca031a485db038587e43bda4ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.918178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b3ceca031a485db038587e43bda4ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.919541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a402216-e45c-44f3-b4e0-3d59a4975eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b3ceca031a485db038587e43bda4ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:43.933338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1007/2004] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:43 2022] DELETE /identity/v3/users/a9b3ceca031a485db038587e43bda4ff => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:44.260395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:44.262215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:44.298184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60c3c-8e21-46e3-8aed-0dcac91e7771 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:44.399839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:44.400805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:44.401205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:44.401681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] PATH_INFO: `/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:44.403137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d0d39e0f9944e1a4fca8712ba5aa22)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:44.409766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:44.486576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d0d39e0f9944e1a4fca8712ba5aa22', 'request_id': 'req-80b7101e-a2c6-4063-bef9-299d4d6af2f0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:44.500378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d0d39e0f9944e1a4fca8712ba5aa22', 'request_id': 'req-80b7101e-a2c6-4063-bef9-299d4d6af2f0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:44.524668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d0d39e0f9944e1a4fca8712ba5aa22', 'request_id': 'req-80b7101e-a2c6-4063-bef9-299d4d6af2f0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:44.539091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] The token cache is being invalidate because project d1d0d39e0f9944e1a4fca8712ba5aa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:44.539383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:44.540114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80b7101e-a2c6-4063-bef9-299d4d6af2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:44.546155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 998/2005] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:44 2022] DELETE /identity/v3/projects/d1d0d39e0f9944e1a4fca8712ba5aa22 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:44.548425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:44.550352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:44.550892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:44.579145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:44.582164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:44.755525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1008/2006] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:44.758126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1887-276d-4032-8c95-c21945252690 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:44.758631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1887-276d-4032-8c95-c21945252690 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:44.759030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a1887-276d-4032-8c95-c21945252690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:44.826138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-745a1887-276d-4032-8c95-c21945252690 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:44.827864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-745a1887-276d-4032-8c95-c21945252690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:44.846191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 999/2007] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:44.852908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:44.888541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fdc1-ae27-4198-b964-a0d8a4ce0661 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:44.896996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:44.897778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:44.898007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:44.898284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:44.898994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:44.899306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:44.900994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:44.923919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1009/2008] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:44.928465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1887-276d-4032-8c95-c21945252690 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:44.940548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a1887-276d-4032-8c95-c21945252690 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:44.948280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:44.949013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:44.949453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:44.949572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:44.950236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:44.952529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:44.984561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:44.994068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1000/2009] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:44 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:44.995131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.001467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:45.007790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001b2f2-d212-49a7-8aef-1352bb87d3f4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.088296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.089010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.089408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.089753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.090514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.092515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.116726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1010/2010] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:44 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:45.117983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.130524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c53802-db11-48f0-b52e-5d09d40e36d4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.135379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.136001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.136286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.136563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.137259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.138933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.150049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1001/2011] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:45.154287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.185828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c99e-29b3-4dce-b6c5-60a8f81e5a8a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.185828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.185828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.185828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.186168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.189183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.189183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d151c-870a-4d21-850b-0fc50081345d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.201704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1011/2012] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:45.205841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.216514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147888-8b08-43b2-b8bd-17748d13b69f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.226613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.227324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.227606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.227880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] PATH_INFO: `/v3/projects/33a0de1215bb41339b82c82446a663f1/users/547ef0f50e824969ae2a0f7de403a441/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.243266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a0de1215bb41339b82c82446a663f1, user_id=547ef0f50e824969ae2a0f7de403a441, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.245978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.261110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1002/2013] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:45 2022] PUT /identity/v3/projects/33a0de1215bb41339b82c82446a663f1/users/547ef0f50e824969ae2a0f7de403a441/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:45.273000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.273318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.273605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.301647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] MFA Rules not processed for user `547ef0f50e824969ae2a0f7de403a441`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:45.302894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:45.376487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1012/2014] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:45.381627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.471775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276e2e-d44d-4a30-8282-912f8827d9ed admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.477458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.478196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.478538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.478885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.479776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.481971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.497226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.498696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:45.511454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1003/2015] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:45 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:45.515219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.516093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ab7a2-6c3b-4bdb-970b-e9508c059cd7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.580756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.581603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.581965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.582843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] PATH_INFO: `/v3/users/81960d89f2204a72b1a96db85a35e7e7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.584370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81960d89f2204a72b1a96db85a35e7e7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.586621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.587559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dd31-96e3-4376-8fe0-2e82e859539c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.603471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.605313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.605313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.605525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.606151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.608121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.616414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:45.637336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1004/2016] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:45 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:45.641500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.656845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be605893-01f9-40f3-8976-57f79aa0eef5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.662683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.663310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.663594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.663873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.664572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.666218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.671034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81960d89f2204a72b1a96db85a35e7e7'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:45.676642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1005/2017] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:45.678511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81960d89f2204a72b1a96db85a35e7e7'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:45.679740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81960d89f2204a72b1a96db85a35e7e7'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:45.681613 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.692412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81960d89f2204a72b1a96db85a35e7e7'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:45.692570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f3e6-c794-41ee-86cf-3c4193abbffc admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.693153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-338b1b10-e73d-4f99-baa1-56c418f4e4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81960d89f2204a72b1a96db85a35e7e7'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:45.697661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.698464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.698984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.699352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.700147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.702340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.705797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1013/2018] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:45 2022] DELETE /identity/v3/users/81960d89f2204a72b1a96db85a35e7e7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:45.710778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.711727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.713088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.742755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1006/2019] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:45.743017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:45.743017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:45.744344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.749401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:45.784317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e66c-264b-47ca-8b0d-012d237bce0c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.809919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:45.853865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1014/2020] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:45.866019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:45.867581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:45.918708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.919781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.920479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.921358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] PATH_INFO: `/v3/projects/3669ce349ac14e06a3af7ed504f88977/users/4b227f6a4b334d9b80ffecefd2f06661/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.944138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3669ce349ac14e06a3af7ed504f88977, user_id=4b227f6a4b334d9b80ffecefd2f06661, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.948662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df718e-6bda-4f03-8fbc-cd1c375ef1fa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:45.949992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec52ef-ba7b-440f-85f1-513329404f2b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:45.957465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:45.957465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:45.958665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:45.959888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:45.993624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:45.995374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.004155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1007/2021] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:45 2022] PUT /identity/v3/projects/3669ce349ac14e06a3af7ed504f88977/users/4b227f6a4b334d9b80ffecefd2f06661/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:46.007121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1015/2022] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:46.014470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.014757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.015036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.056325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] MFA Rules not processed for user `4b227f6a4b334d9b80ffecefd2f06661`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:46.057948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.144318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1008/2023] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:46.148911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.159281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a396aa-7d94-47d2-930a-df9d8a5f52b0 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.196777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:46.241023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.241898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.242187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.242558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.243336 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.245582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.282157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1016/2024] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:04:46.287319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.304395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ec1c4-cf4d-45b2-99a2-12112e556729 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.390518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.391264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.391723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.392817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.394295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.399405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.433180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1009/2025] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:46.437620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.459306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be421-9622-4b10-97f3-55b7bd097226 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.468504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.470665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.471377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.471946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.474825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.477103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.481820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.490576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.498655 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247eed-f808-4378-854f-5855af573efe admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.514774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.515538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.522415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.522967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] PATH_INFO: `/v3/projects/9ee0a1793da642e6b51a054e1392c90d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.524830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee0a1793da642e6b51a054e1392c90d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.526434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1017/2026] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:46.527397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.528365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.548789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9ce19-f4c4-43c2-8a0f-e8abe379f1a8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.572222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:46.590848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.592629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.592918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.593252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] PATH_INFO: `/v3/projects/e51f5017de934c97a039f152c3d7c194/users/1eac57ad311943b89495c6b851dbe981/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.609839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee0a1793da642e6b51a054e1392c90d', 'request_id': 'req-7f3bc915-c5a0-4313-a332-8ab00e0d2726'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:46.611026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f5017de934c97a039f152c3d7c194, user_id=1eac57ad311943b89495c6b851dbe981, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.614236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.619679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee0a1793da642e6b51a054e1392c90d', 'request_id': 'req-7f3bc915-c5a0-4313-a332-8ab00e0d2726'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:46.628748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee0a1793da642e6b51a054e1392c90d', 'request_id': 'req-7f3bc915-c5a0-4313-a332-8ab00e0d2726'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:46.633957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1018/2027] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:46 2022] PUT /identity/v3/projects/e51f5017de934c97a039f152c3d7c194/users/1eac57ad311943b89495c6b851dbe981/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:46.637602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.641558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] The token cache is being invalidate because project 9ee0a1793da642e6b51a054e1392c90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:46.642069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:46.643321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7f3bc915-c5a0-4313-a332-8ab00e0d2726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:46.646216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1010/2028] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:46 2022] DELETE /identity/v3/projects/9ee0a1793da642e6b51a054e1392c90d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:46.651387 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740629f1-ab0e-4cca-8fa4-81feb6a1e515 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.651684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740629f1-ab0e-4cca-8fa4-81feb6a1e515 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.651959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740629f1-ab0e-4cca-8fa4-81feb6a1e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.685321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-740629f1-ab0e-4cca-8fa4-81feb6a1e515 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:46.686947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-740629f1-ab0e-4cca-8fa4-81feb6a1e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.746623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6464-4305-4720-95fd-fd020e2c2f38 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.753356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.754507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.754789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.755068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.755561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1011/2029] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:46.755764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.757496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.763072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.763443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.764233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.769312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1019/2030] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:04:46.774111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.776598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.790833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:46.792050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.800579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9502c-f0e1-4ae8-81d2-71ed00709c26 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.802793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1012/2031] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:46.807195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.808053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.809147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.809650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.810113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] PATH_INFO: `/v3/projects/e51f5017de934c97a039f152c3d7c194/users/1eac57ad311943b89495c6b851dbe981/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.813307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f5017de934c97a039f152c3d7c194, user_id=1eac57ad311943b89495c6b851dbe981, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.821300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14edacb-bd8a-43d1-89bf-ae325360fb00 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.821481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b9a8-ee0e-4ff4-b4c4-31a524b2bb0d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.844324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1020/2032] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:46 2022] PUT /identity/v3/projects/e51f5017de934c97a039f152c3d7c194/users/1eac57ad311943b89495c6b851dbe981/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:04:46.853305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.854429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.855010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.861846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.862636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:04:46.863125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.864826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:46.868305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.869086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.869305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.885482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1013/2033] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:04:46.890189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:46.902214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900d81-c3b4-4303-b047-2bd16a4ff31b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:46.925604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] MFA Rules not processed for user `1eac57ad311943b89495c6b851dbe981`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:46.928310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:46.966865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:46.967873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:46.968224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:46.968572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:46.969433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:46.972179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.001176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:47.002800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1014/2034] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:47.007311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.017740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:47.027796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1021/2035] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:47.040257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.041857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:47.081183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c107c-1790-4b76-8128-5135786bacd6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.086395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.087214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.087500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.087780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.088450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.091477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.104865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35cb91-cb35-4262-a640-282ba65d646e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.122304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1015/2036] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:04:47 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:04:47.123657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.135019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7b384-f08e-40db-8a20-853059c97e32 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.140644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.141549 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.141837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.142113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.142952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.145225 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.170193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1016/2037] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:47.171581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.190252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c955cd1-8c47-493e-ae1b-e8e2a1934548 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.197689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.198762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.199274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.199711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.200415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.202088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.211913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.211913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.211913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.212247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.213341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1017/2038] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:04:47.217529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.227490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8892-d4ba-487a-96db-d669a61bf54c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.232093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.232758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.233039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.233345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] PATH_INFO: `/v3/projects/c44d45aad62942c68e2b154cdbe0e158/users/f171e47a79bb498296adec90701868a1/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.251643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44d45aad62942c68e2b154cdbe0e158, user_id=f171e47a79bb498296adec90701868a1, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.255056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f473850-ae80-4844-9bbc-d10d22a75ba5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.272816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1018/2039] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:04:47 2022] PUT /identity/v3/projects/c44d45aad62942c68e2b154cdbe0e158/users/f171e47a79bb498296adec90701868a1/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:47.282985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.283147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.283682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.286270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.287729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.298588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1022/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:47.315224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] MFA Rules not processed for user `f171e47a79bb498296adec90701868a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:47.317091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:47.352894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.354975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:47.370182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb0b1-2924-495f-8855-20ca4a28e9c1 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.397616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1019/2041] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:04:47.409609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:47.434433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.435026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.435311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.435591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.437556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:47.449501 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:47.470703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:47.515449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f221578-ec41-40d9-b0ed-31b8b5b3607e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:47.519394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:47.520081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:47.520369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:47.520641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:47.530095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.531561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.535675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:47.537137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a862a6b-8c9b-49e2-a538-8f7056919127 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:47.543816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1020/2042] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:04:47.555276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1023/2043] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:51.964142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:52.068129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1e5b-9d6e-4f78-bbe0-f5a7b5ddc165 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:52.074838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:52.075537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:52.075828 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:52.076784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] PATH_INFO: `/v3/users/547ef0f50e824969ae2a0f7de403a441` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:52.078355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547ef0f50e824969ae2a0f7de403a441)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:52.080433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:52.149467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547ef0f50e824969ae2a0f7de403a441'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:52.161869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547ef0f50e824969ae2a0f7de403a441'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:52.162976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547ef0f50e824969ae2a0f7de403a441'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:52.163866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547ef0f50e824969ae2a0f7de403a441'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:52.182624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547ef0f50e824969ae2a0f7de403a441'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:52.217158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1021/2044] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:51 2022] DELETE /identity/v3/users/547ef0f50e824969ae2a0f7de403a441 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:52.222005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:52.224033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:52.224502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:52.258512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:04:52.260395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:52.414882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1024/2045] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:04:52.434444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:52.436537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:52.548033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98368704-59a6-46e1-83bd-eb5fbfbcbdf5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:52.552189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:52.553068 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:52.553548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:52.553817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:52.568540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:52.570105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:52.582656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1022/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:04:53.552721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:53.554192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:53.578931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a7e0-84ac-4c21-98cb-9eae1803ee84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:53.585194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:53.585871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:53.586157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:53.586507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] PATH_INFO: `/v3/projects/33a0de1215bb41339b82c82446a663f1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:53.598725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a0de1215bb41339b82c82446a663f1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:53.600825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:53.671582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a0de1215bb41339b82c82446a663f1', 'request_id': 'req-69745857-6c72-4887-91d9-13cc4bf325ad'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.681514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a0de1215bb41339b82c82446a663f1', 'request_id': 'req-69745857-6c72-4887-91d9-13cc4bf325ad'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.687967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a0de1215bb41339b82c82446a663f1', 'request_id': 'req-69745857-6c72-4887-91d9-13cc4bf325ad'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.700265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] The token cache is being invalidate because project 33a0de1215bb41339b82c82446a663f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:53.700726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.701714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.706608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1025/2047] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:53 2022] DELETE /identity/v3/projects/33a0de1215bb41339b82c82446a663f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:53.708504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:53.718928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105fa81-5f51-4653-9e54-c1680f8eb67c service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:53.723710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:53.805175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:53.806546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:53.806833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:53.807110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] PATH_INFO: `/v3/users/4b227f6a4b334d9b80ffecefd2f06661` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:53.808328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b227f6a4b334d9b80ffecefd2f06661)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:53.813768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:53.903891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b227f6a4b334d9b80ffecefd2f06661'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.913958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b227f6a4b334d9b80ffecefd2f06661'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.914675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b227f6a4b334d9b80ffecefd2f06661'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.915367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b227f6a4b334d9b80ffecefd2f06661'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.930982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b227f6a4b334d9b80ffecefd2f06661'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:53.955761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1023/2048] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:53 2022] DELETE /identity/v3/users/4b227f6a4b334d9b80ffecefd2f06661 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:54.386761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:54.388491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:54.442673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69745857-6c72-4887-91d9-13cc4bf325ad admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:54.489297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:54.526749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:54.540294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:54.540294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:54.540294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] PATH_INFO: `/v3/projects/3669ce349ac14e06a3af7ed504f88977` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:54.540294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3669ce349ac14e06a3af7ed504f88977)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:54.540294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:54.590386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3669ce349ac14e06a3af7ed504f88977', 'request_id': 'req-757d6b36-1835-47f3-93e4-185622afe38a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.599333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3669ce349ac14e06a3af7ed504f88977', 'request_id': 'req-757d6b36-1835-47f3-93e4-185622afe38a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.605078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3669ce349ac14e06a3af7ed504f88977', 'request_id': 'req-757d6b36-1835-47f3-93e4-185622afe38a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.618129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] The token cache is being invalidate because project 3669ce349ac14e06a3af7ed504f88977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:54.618639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.619559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.621294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1026/2049] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:54 2022] DELETE /identity/v3/projects/3669ce349ac14e06a3af7ed504f88977 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:54.625027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:54.626491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:54.639844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a3ea-aa73-460a-89bf-a527ef66ec7e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:54.697198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:54.697805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:54.698087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:54.698385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] PATH_INFO: `/v3/users/1eac57ad311943b89495c6b851dbe981` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:54.699528 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eac57ad311943b89495c6b851dbe981)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:54.701483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:54.729760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:54.749827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eac57ad311943b89495c6b851dbe981'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.757351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eac57ad311943b89495c6b851dbe981'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.758012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eac57ad311943b89495c6b851dbe981'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.758621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eac57ad311943b89495c6b851dbe981'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.770224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eac57ad311943b89495c6b851dbe981'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:54.782956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1024/2050] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:04:54 2022] DELETE /identity/v3/users/1eac57ad311943b89495c6b851dbe981 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:04:55.067488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:04:55.069002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:04:55.087762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d6b36-1835-47f3-93e4-185622afe38a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:04:55.154995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:04:55.155653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:04:55.155929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:04:55.156208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] PATH_INFO: `/v3/projects/e51f5017de934c97a039f152c3d7c194` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:04:55.157597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51f5017de934c97a039f152c3d7c194)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:04:55.160433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:04:55.225439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51f5017de934c97a039f152c3d7c194', 'request_id': 'req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:55.235824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51f5017de934c97a039f152c3d7c194', 'request_id': 'req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:55.242271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51f5017de934c97a039f152c3d7c194', 'request_id': 'req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:55.244284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:55.256597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] The token cache is being invalidate because project e51f5017de934c97a039f152c3d7c194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:04:55.257022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:55.257811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83ae9e1e-f28c-48c8-8bb1-d5f4ebf99929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:04:55.259441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1027/2051] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:04:55 2022] DELETE /identity/v3/projects/e51f5017de934c97a039f152c3d7c194 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:00.877172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:00.878720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:00.891841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79c1-9e93-4323-8407-1b1772295240 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:00.961097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:00.962483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:00.962768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:00.963202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] PATH_INFO: `/v3/users/f171e47a79bb498296adec90701868a1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:00.965072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f171e47a79bb498296adec90701868a1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:00.967031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:01.072282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f171e47a79bb498296adec90701868a1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.096452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f171e47a79bb498296adec90701868a1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.101648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f171e47a79bb498296adec90701868a1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.103689 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f171e47a79bb498296adec90701868a1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.132834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f171e47a79bb498296adec90701868a1'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.153311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1025/2052] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:00 2022] DELETE /identity/v3/users/f171e47a79bb498296adec90701868a1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:01.158446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:01.162279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:01.163984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:01.197152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:01.198514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:01.280006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1028/2053] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:01.290520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:01.291974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:01.324507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:01.362056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e13fe-e80f-463b-8ebc-657a0110f7ba admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:01.366206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:01.366851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:01.367135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:01.367412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:01.378302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:01.379856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f2b5-b5f2-4589-9b7a-929e40b2d85a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:01.391213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1026/2054] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:01.812171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:01.813839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:01.826494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190fd29-7a89-467c-b7ae-00e042dbf92d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:01.843974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:01.845342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:01.846616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:01.847629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] PATH_INFO: `/v3/projects/c44d45aad62942c68e2b154cdbe0e158` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:01.860936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44d45aad62942c68e2b154cdbe0e158)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:01.864352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:01.958689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44d45aad62942c68e2b154cdbe0e158', 'request_id': 'req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.973084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44d45aad62942c68e2b154cdbe0e158', 'request_id': 'req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.980674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44d45aad62942c68e2b154cdbe0e158', 'request_id': 'req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:01.997640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] The token cache is being invalidate because project c44d45aad62942c68e2b154cdbe0e158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:02.005039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:02.005039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d8b3e6ed-27df-4e3c-bd5a-f1200b3f6393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:02.005039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1029/2055] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:01 2022] DELETE /identity/v3/projects/c44d45aad62942c68e2b154cdbe0e158 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:02.008383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.008837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.009283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.033714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:02.035571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:02.137283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1027/2056] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:02.139298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.139815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.140129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.162422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:02.163646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:02.176435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1030/2057] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:02.178358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.190310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15120a-bdce-4234-b0a7-82390d780c3f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.203367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.204154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.204539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.205418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.206786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:02.207326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.209214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.223967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1028/2058] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:05:02.228464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.241857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7e035-11a3-4702-b99f-4dddabe0db9e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.246729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.247350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.247805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.248232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.249074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.251330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.291205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1031/2059] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:02.297958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.311236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df92195-8ddc-47ee-a748-24086b91a7f2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.383521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.384232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.384588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.385094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.385899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.387837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.419713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1029/2060] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:02.423601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.434974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252933a-4acc-4d78-8b9b-251e85b3af3a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.442277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.443378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.443688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.444124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.445112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.455027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.470775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1032/2061] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:02.474643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.487214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6b121-a345-4eda-94a0-4f2b0bc20c88 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.492471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.493404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.493741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.494124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.494932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.496657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020a798-2280-493d-8148-9b943b2b9263 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.509562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1030/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:02.513663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.525246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb32526-f377-4ffe-839a-3a51da69fabd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.530301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.531327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.531825 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.532516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] PATH_INFO: `/v3/projects/f399e7f641c643b4bd8d30a8409311e9/users/dd2a8f6aa9ed4d20be63662d0a901427/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.573404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f399e7f641c643b4bd8d30a8409311e9, user_id=dd2a8f6aa9ed4d20be63662d0a901427, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.576370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:02.603810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1033/2063] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:02 2022] PUT /identity/v3/projects/f399e7f641c643b4bd8d30a8409311e9/users/dd2a8f6aa9ed4d20be63662d0a901427/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:02.615053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.615053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.615053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.674021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] MFA Rules not processed for user `dd2a8f6aa9ed4d20be63662d0a901427`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:02.676279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:02.720766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:02.841045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1031/2064] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:02.846670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:02.876377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:02.969252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62abb9-d78f-4d93-b4ff-05e47a5b3ca3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:02.976130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:02.977632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:02.977632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:02.977835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:02.981153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:02.985146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.043128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1034/2065] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:02 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:03.044650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.057231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d121f3-8446-4f31-bf89-2d2f782f1be2 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.125648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.126367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.126656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.126934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.127622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.129652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.151931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1032/2066] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:03.157601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.169737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa03940-11a3-47d9-a86c-4764f7d1ae00 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.174708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.176171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.176536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.176885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.177674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.179341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.195131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1035/2067] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:03.198566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.213003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504f802-1610-413d-8087-05389a6f44c9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.218176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.218819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.219106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.219382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.220086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.221776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987b62-4dc7-4cc3-9962-24d8b683ee87 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.233486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1033/2068] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:05:03.238751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.249061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d966a-294d-479c-b0f5-6638aa6913ca admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.253809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.254482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.254766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.255048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] PATH_INFO: `/v3/projects/e295e8a4b3b24ec0b8807db1e75752e3/users/fff2cb02029b465d8feef06dca70b01c/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.271263 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e295e8a4b3b24ec0b8807db1e75752e3, user_id=fff2cb02029b465d8feef06dca70b01c, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.274487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bddc-1282-47a0-a689-a68f2b85fb27 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.282373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a4c6-b4dc-417c-ae93-dc8b95af5b32 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.282661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a4c6-b4dc-417c-ae93-dc8b95af5b32 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.283216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a4c6-b4dc-417c-ae93-dc8b95af5b32 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.285084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1034/2069] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:05:03.289853 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1036/2070] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:03 2022] PUT /identity/v3/projects/e295e8a4b3b24ec0b8807db1e75752e3/users/fff2cb02029b465d8feef06dca70b01c/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:03.302735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.303024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.303301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.323868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.324096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.324382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.343804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] MFA Rules not processed for user `fff2cb02029b465d8feef06dca70b01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:03.345360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.345774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] MFA Rules not processed for user `845ce3ae6fd44a66b9fbe5a9c12e7eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:03.348212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.423096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1037/2071] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:03.424042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.426056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.438307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1035/2072] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:03.439242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.440618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.455765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28205-b3a5-421c-8a03-3499036800ec None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.461874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.462546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.462898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.463251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.473966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.475535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.487733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1036/2073] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:03.491756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.517050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:03.523538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490ea44-4a6c-40eb-b424-bcd2e50beeb6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.529412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.530067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.530429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.531110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] PATH_INFO: `/v3/users/6f8503fe77164458acb957043e1c57ff` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.532507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8503fe77164458acb957043e1c57ff)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.535563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.542566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:03.579398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416852ee-1d76-4da6-8657-6fd0384f30f9 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.584783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.585507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.585872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.586158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.586930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.588852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.589562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8503fe77164458acb957043e1c57ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.597881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8503fe77164458acb957043e1c57ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.598714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8503fe77164458acb957043e1c57ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.612017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8503fe77164458acb957043e1c57ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.612866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8503fe77164458acb957043e1c57ff'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.619456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1037/2074] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:03.623483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.625525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.629922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1038/2075] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:03 2022] DELETE /identity/v3/users/6f8503fe77164458acb957043e1c57ff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:03.698734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482aeb3-dddb-4e4e-a091-9037d3a65303 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.755472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.756106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.756386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.756657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.757355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.759287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.781493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1038/2076] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:03.786746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.798909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e9c1a-9ad9-422d-b13b-c108f467a7da admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.803945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.804563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.804845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.805124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.805870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.807541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.809069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.811331 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.821316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1039/2077] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:05:03.822799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.827041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c65bd-36e9-43fd-a4b7-b55c73bd6752 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.833575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.833754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3339-f3fe-4109-94ef-9c9ca0fe7b84 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.834393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.834799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.835131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] PATH_INFO: `/v3/projects/00169220b9644d458ec159decb275c47` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.837015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00169220b9644d458ec159decb275c47)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.839101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.839966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.840254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.840375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.840548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] PATH_INFO: `/v3/projects/8822367eceec4db7a2aafd6dfca909fb/users/a13b3732b452450c96e63dcecfd815a9/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.857502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8822367eceec4db7a2aafd6dfca909fb, user_id=a13b3732b452450c96e63dcecfd815a9, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.860605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.885423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:03.898079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1040/2078] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:03 2022] PUT /identity/v3/projects/8822367eceec4db7a2aafd6dfca909fb/users/a13b3732b452450c96e63dcecfd815a9/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:05:03.902076 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:03.915449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00169220b9644d458ec159decb275c47', 'request_id': 'req-51f5598f-0163-4518-b3ef-227ea735d29f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.926099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00169220b9644d458ec159decb275c47', 'request_id': 'req-51f5598f-0163-4518-b3ef-227ea735d29f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.937041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00169220b9644d458ec159decb275c47', 'request_id': 'req-51f5598f-0163-4518-b3ef-227ea735d29f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.950480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] The token cache is being invalidate because project 00169220b9644d458ec159decb275c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:03.950778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.951978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-51f5598f-0163-4518-b3ef-227ea735d29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:03.953862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1039/2079] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:03 2022] DELETE /identity/v3/projects/00169220b9644d458ec159decb275c47 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:03.958950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409cc4-443b-4e99-accd-7ab563879219 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.959312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409cc4-443b-4e99-accd-7ab563879219 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.959598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409cc4-443b-4e99-accd-7ab563879219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.987251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-30409cc4-443b-4e99-accd-7ab563879219 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:03.988503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-30409cc4-443b-4e99-accd-7ab563879219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:03.988615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d346d9-47b6-42fb-8538-216009e1f1df admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:03.993192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:03.993850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:03.994139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:03.994419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:03.995121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:03.996724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:03.997030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1040/2080] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:04.005026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.005347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.007404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.009316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1041/2081] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:04.011742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.014227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.030461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:04.031802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.032308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15e09-fd2e-498e-8515-35f2a083af39 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.037854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.038746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.039205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.039640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] PATH_INFO: `/v3/projects/8822367eceec4db7a2aafd6dfca909fb/users/a13b3732b452450c96e63dcecfd815a9/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.040386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1041/2082] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:04.042255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8822367eceec4db7a2aafd6dfca909fb, user_id=a13b3732b452450c96e63dcecfd815a9, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.044497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.044910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef12826-79d0-4da6-b249-20ebc705c235 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.054602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c51061-af8b-4921-8668-d407faa37678 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.058861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1042/2083] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:04 2022] PUT /identity/v3/projects/8822367eceec4db7a2aafd6dfca909fb/users/a13b3732b452450c96e63dcecfd815a9/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:05:04.071037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.071655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.072512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.107586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] MFA Rules not processed for user `a13b3732b452450c96e63dcecfd815a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:04.109299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.119480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.120243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.120542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.120898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.121569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:04.121879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.123523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.133632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:04.138094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1042/2084] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:05:04.142311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.152791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b29df-f7dd-4ef3-a166-9902636de2e8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.157579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.158458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.158736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.159015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.159834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.161930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.191892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1043/2085] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:04.192644 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1043/2086] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:04.196806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.203077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.204827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.208337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ca2e-ebb9-49df-8bc8-7895ee34b8cd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.271425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3596e5-35be-4ead-91c5-8b6a5eaa58ab admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.274888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.275144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16398019-2d5f-473a-9289-991843187520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.275514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.275767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16398019-2d5f-473a-9289-991843187520 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.275868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.276052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16398019-2d5f-473a-9289-991843187520 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.276152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.276330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16398019-2d5f-473a-9289-991843187520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.276720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.278160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-16398019-2d5f-473a-9289-991843187520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.278680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.312432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1044/2087] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:04 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:04.314007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.317182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:04.324775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357734f-0490-438e-a860-f07c6282d58b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.329999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.330612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.330913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.331298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.333152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.334822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.345906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1045/2088] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:04.349876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.353289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16398019-2d5f-473a-9289-991843187520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.354775 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16398019-2d5f-473a-9289-991843187520 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.359740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5815037-beed-4a4f-84f4-0ca05f3fcb92 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.366307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1044/2089] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:05:04.367672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.368509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.368795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.369130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.370122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.372393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9ab2a-ff28-4680-b965-9350b9627c60 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.384927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1046/2090] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:04.389378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16398019-2d5f-473a-9289-991843187520 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.407563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16398019-2d5f-473a-9289-991843187520 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.407563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.407563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.407563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.407899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] PATH_INFO: `/v3/projects/2606969f81ab44ae90b579fb9dc56f56/users/dd02eac802ef4cfb81f8670124bc894f/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.423493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2606969f81ab44ae90b579fb9dc56f56, user_id=dd02eac802ef4cfb81f8670124bc894f, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.426948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.442651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1045/2091] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:04 2022] PUT /identity/v3/projects/2606969f81ab44ae90b579fb9dc56f56/users/dd02eac802ef4cfb81f8670124bc894f/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:04.448113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.448113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.448331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.467781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:04.468996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.481845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.483609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.547861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1047/2092] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:04.556360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:04.557852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.570675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088115a-0c1f-4688-b2c5-1483281eb4ba admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.574873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.575510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.575804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.576080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.585770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:04.591370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:04.640183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a364-7090-4568-a6c2-aeb0fe9c4413 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:04.661507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:04.661507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:04.661507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:04.661507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:04.674020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.677217 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.683742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:04.685924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:04.690872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1048/2093] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:05:04.698227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1046/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:05:06.106348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:06.118365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74e12-c017-491b-a569-3efbd6cca6ca service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:06.132287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:06.133288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:06.133784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:06.134315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:06.140119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:06.279228 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:06.282596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:06.296281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1049/2095] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:07.074850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:07.085384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5542af-e552-4ef0-886c-5ccaa796e11b service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:07.089363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:07.090402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:07.090781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:07.091208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:07.164396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:07.166957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:07.169183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072af13-0274-4652-8e9e-22b0fd20f58f service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:07.182012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1047/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:07.635098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:07.637640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:07.653261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f245d-7465-4aab-880b-d6617d7d0480 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:07.658774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:07.659955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:07.660433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:07.660916 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] PATH_INFO: `/v3/users/22a867b6e8a04b32b8a2bbebbd3a74be` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:07.662518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a867b6e8a04b32b8a2bbebbd3a74be)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:07.669418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:07.731697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a867b6e8a04b32b8a2bbebbd3a74be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:07.745178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a867b6e8a04b32b8a2bbebbd3a74be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:07.746471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a867b6e8a04b32b8a2bbebbd3a74be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:07.765034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a867b6e8a04b32b8a2bbebbd3a74be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:07.766237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a867b6e8a04b32b8a2bbebbd3a74be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:07.785631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1050/2097] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:07 2022] DELETE /identity/v3/users/22a867b6e8a04b32b8a2bbebbd3a74be => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:07.787474 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:07.787903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:07.788256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:07.825449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:07.827086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:07.956573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1048/2098] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:07.967316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:07.969006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:08.016773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:08.040353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5757c-d24e-412b-b9b8-e6c3da674c60 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:08.044771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:08.045994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:08.046526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:08.047079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:08.062216 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:08.064900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555622ee-dfa2-404f-982e-ff86a3c6373a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:08.078355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1051/2099] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:08.473446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:08.476028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:08.497029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a425a0d-1483-4e3f-a4be-29002fc1d25f None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:08.521790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:08.522465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:08.522753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:08.523034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] PATH_INFO: `/v3/projects/f8e636f5b1f740a8a89f63bab146b67d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:08.524391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e636f5b1f740a8a89f63bab146b67d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:08.526833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:08.625620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e636f5b1f740a8a89f63bab146b67d', 'request_id': 'req-2322325b-46ca-4038-9bcd-a76d989c9e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:08.637736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e636f5b1f740a8a89f63bab146b67d', 'request_id': 'req-2322325b-46ca-4038-9bcd-a76d989c9e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:08.650095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e636f5b1f740a8a89f63bab146b67d', 'request_id': 'req-2322325b-46ca-4038-9bcd-a76d989c9e47'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:08.667492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] The token cache is being invalidate because project f8e636f5b1f740a8a89f63bab146b67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:08.675884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:08.677439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2322325b-46ca-4038-9bcd-a76d989c9e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:08.683350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1049/2100] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:08 2022] DELETE /identity/v3/projects/f8e636f5b1f740a8a89f63bab146b67d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:08.685150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:08.685640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:08.685930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:08.745987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:08.749494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:08.926562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1052/2101] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:08.935761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:08.936048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:08.936312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:08.961374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:08.962713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:08.978164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:08.984725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1050/2102] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:08.990301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93913c9-d03c-435f-a9bd-453667e1264f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:08.998490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:08.999552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:08.999917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.000248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.001176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:09.001654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.004574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.018331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1053/2103] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:05:09.023317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.036457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bf3eb-ad97-4cc8-94e7-f6e55b036c38 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.043170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.044182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.044676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.045207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.046564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.049013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.103326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1051/2104] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:09 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:09.108162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.121129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c66df-fa06-4dca-a732-8bf16d1e2a98 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.194579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.195219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.195550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.195832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.196503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.198669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.228312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1054/2105] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:09 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:09.230266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.245767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3202f-56b2-4589-9fb9-224a4e9f0b40 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.251149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.252513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.253371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.253840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.254601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.256491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.270833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1052/2106] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:09.273221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.284471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdefd-d839-4d41-acf4-6ac606e3f66f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.291240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.291240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.293092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.293092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.293092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.294428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daca1-3332-4c41-9e29-59a3911ab5fc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.311098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1055/2107] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:05:09.314202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.327008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f01c-9ccd-4dd4-bbbc-aae57e5719d8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.332932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.333881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.334348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.335020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] PATH_INFO: `/v3/projects/0a65a50d88054742bc5f01d27afa39f4/users/fb872ee32a634f70a828a2456066449d/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.352232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a65a50d88054742bc5f01d27afa39f4, user_id=fb872ee32a634f70a828a2456066449d, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.354823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.372435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1053/2108] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:09 2022] PUT /identity/v3/projects/0a65a50d88054742bc5f01d27afa39f4/users/fb872ee32a634f70a828a2456066449d/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:09.384513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eae3-847e-4d3c-8667-87b821e88da2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.385103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eae3-847e-4d3c-8667-87b821e88da2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.385536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419eae3-847e-4d3c-8667-87b821e88da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.416458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c419eae3-847e-4d3c-8667-87b821e88da2 None None] MFA Rules not processed for user `fb872ee32a634f70a828a2456066449d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:09.418090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c419eae3-847e-4d3c-8667-87b821e88da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:09.456889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:09.501149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1056/2109] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:09.510111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:09.511870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:09.536541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:09.599690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c490-2752-4265-af54-59ca66ad7a7f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:09.603391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:09.604127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:09.604475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:09.604824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:09.614909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:09.617092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:09.635796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1054/2110] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:10.376858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:10.377427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:10.378487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:10.449159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] MFA Rules not processed for user `dd02eac802ef4cfb81f8670124bc894f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:10.451552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:10.604146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1057/2111] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:10.620658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:10.624129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:10.727347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0187-ba6f-4537-8ce0-bc10c8dafa14 service glance] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:10.734062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:10.734872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:10.735257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:10.735636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:10.746344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:10.748041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6e32c-6651-4846-83d4-1fe9fd6904e2 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:10.759663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1055/2112] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:11.727423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:11.728968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:11.803626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31b40-d14a-4a9d-a42d-c2a7a84d8883 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:11.808641 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:11.809416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:11.809766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:11.810108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] PATH_INFO: `/v3/users/dd2a8f6aa9ed4d20be63662d0a901427` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:11.811368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2a8f6aa9ed4d20be63662d0a901427)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:11.813468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:11.914643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2a8f6aa9ed4d20be63662d0a901427'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:11.926567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2a8f6aa9ed4d20be63662d0a901427'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:11.927457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2a8f6aa9ed4d20be63662d0a901427'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:11.937774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:11.945790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2a8f6aa9ed4d20be63662d0a901427'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:11.949979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2a8f6aa9ed4d20be63662d0a901427'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:11.976835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1058/2113] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:11 2022] DELETE /identity/v3/users/dd2a8f6aa9ed4d20be63662d0a901427 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:11.981446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df83b1-ee50-438d-8ec6-fed3292633cd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:11.981938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df83b1-ee50-438d-8ec6-fed3292633cd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:11.982018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df83b1-ee50-438d-8ec6-fed3292633cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:12.005831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-00df83b1-ee50-438d-8ec6-fed3292633cd None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:12.007115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-00df83b1-ee50-438d-8ec6-fed3292633cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:12.083397 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1056/2114] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:12.093108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:12.094660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:12.162975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32c46-3c98-4caf-acab-5354d7740a4b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:12.167652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:12.168341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:12.168634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:12.168919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:12.180197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:12.181700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:12.194714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1059/2115] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:12.327767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:12.328054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:12.328332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:12.351119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] MFA Rules not processed for user `dd02eac802ef4cfb81f8670124bc894f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:12.352365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:12.422409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:12.439766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1057/2116] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:12.523742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:12.525177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:12.541978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa4f3-fc49-4565-9729-c0e707222a4e service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:12.553485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:12.554792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:12.555273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:12.555722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] PATH_INFO: `/v3/projects/f399e7f641c643b4bd8d30a8409311e9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:12.557885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f399e7f641c643b4bd8d30a8409311e9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:12.560358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:12.633938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f399e7f641c643b4bd8d30a8409311e9', 'request_id': 'req-17bf64cb-055e-49b4-b1c2-fe2da496085a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.645747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f399e7f641c643b4bd8d30a8409311e9', 'request_id': 'req-17bf64cb-055e-49b4-b1c2-fe2da496085a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.653108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f399e7f641c643b4bd8d30a8409311e9', 'request_id': 'req-17bf64cb-055e-49b4-b1c2-fe2da496085a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.669764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] The token cache is being invalidate because project f399e7f641c643b4bd8d30a8409311e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:12.670730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.671548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.674162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1060/2117] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:12 2022] DELETE /identity/v3/projects/f399e7f641c643b4bd8d30a8409311e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:12.678085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:12.698706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b8a4-1245-4723-a688-a2e2a766eacf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:12.805123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:12.806310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:12.806756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:12.807185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] PATH_INFO: `/v3/users/fff2cb02029b465d8feef06dca70b01c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:12.809257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff2cb02029b465d8feef06dca70b01c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:12.812408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:12.904415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff2cb02029b465d8feef06dca70b01c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.928791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff2cb02029b465d8feef06dca70b01c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.929570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff2cb02029b465d8feef06dca70b01c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.930196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff2cb02029b465d8feef06dca70b01c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.947449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff2cb02029b465d8feef06dca70b01c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:12.974439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1058/2118] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:12 2022] DELETE /identity/v3/users/fff2cb02029b465d8feef06dca70b01c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:13.413663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:13.415720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:13.460391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf64cb-055e-49b4-b1c2-fe2da496085a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:13.599882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:13.600640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:13.601158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:13.601645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] PATH_INFO: `/v3/projects/e295e8a4b3b24ec0b8807db1e75752e3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:13.604892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e295e8a4b3b24ec0b8807db1e75752e3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:13.607247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:13.622714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:13.683761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e295e8a4b3b24ec0b8807db1e75752e3', 'request_id': 'req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:13.694793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e295e8a4b3b24ec0b8807db1e75752e3', 'request_id': 'req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:13.702883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e295e8a4b3b24ec0b8807db1e75752e3', 'request_id': 'req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:13.727511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] The token cache is being invalidate because project e295e8a4b3b24ec0b8807db1e75752e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:13.728678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:13.732536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:13.734292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1061/2119] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:13 2022] DELETE /identity/v3/projects/e295e8a4b3b24ec0b8807db1e75752e3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:13.745967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:13.747951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:13.775639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eabd-f65d-4e6d-a079-49b366232916 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:13.909180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:13.910433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:13.910715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:13.910991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] PATH_INFO: `/v3/users/a13b3732b452450c96e63dcecfd815a9` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:13.912335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13b3732b452450c96e63dcecfd815a9)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:13.914348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:13.929902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:14.007607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13b3732b452450c96e63dcecfd815a9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.018808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13b3732b452450c96e63dcecfd815a9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.020798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13b3732b452450c96e63dcecfd815a9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.021886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13b3732b452450c96e63dcecfd815a9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.043044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-97793ddf-2034-4034-bd50-bdc444f94cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13b3732b452450c96e63dcecfd815a9'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.061906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1059/2120] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:13 2022] DELETE /identity/v3/users/a13b3732b452450c96e63dcecfd815a9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:14.521987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:14.524599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:14.553789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c19b-e0f6-44e2-8048-6fad61e6b9d5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:14.666156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:14.667749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:14.669035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:14.669534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] PATH_INFO: `/v3/projects/8822367eceec4db7a2aafd6dfca909fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:14.673421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8822367eceec4db7a2aafd6dfca909fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:14.676017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:14.770267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8822367eceec4db7a2aafd6dfca909fb', 'request_id': 'req-f7334904-40ec-48a0-b3ba-1c837f9d15d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.783224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8822367eceec4db7a2aafd6dfca909fb', 'request_id': 'req-f7334904-40ec-48a0-b3ba-1c837f9d15d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.790742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8822367eceec4db7a2aafd6dfca909fb', 'request_id': 'req-f7334904-40ec-48a0-b3ba-1c837f9d15d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.804484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] The token cache is being invalidate because project 8822367eceec4db7a2aafd6dfca909fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:14.804791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.805489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f7334904-40ec-48a0-b3ba-1c837f9d15d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:14.807206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1062/2121] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:14 2022] DELETE /identity/v3/projects/8822367eceec4db7a2aafd6dfca909fb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:14.812219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:14.812690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:14.812768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:14.836107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:14.837774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:14.924974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1060/2122] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:14.933094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:14.933412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:14.933693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:14.969859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:14.973732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:14.989636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1063/2123] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:14.990463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.000533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20bed5-eaa9-46e6-9db9-13e8cb1dc143 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.005867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.006503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.006786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.007058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.007904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:15.008184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.009921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.027966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1061/2124] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:05:15.029410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.041350 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd89c4-f102-4018-a52e-060bc7f29fa9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.046662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.047306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.047592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.047872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.048844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.050618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.085770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:15.092548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1064/2125] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:15 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:15.096435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.107764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ddd13-b792-4897-bb50-e552b54b20d0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.169327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.170035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.170371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.170646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.171337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.173360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.199087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1062/2126] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:15 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:15.200594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.214295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e47c-d5a2-4aab-8c28-f6c237e6e7cf admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.219145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.219782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.220063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.220340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.221131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.222933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.243902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1065/2127] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:15.248071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.256191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:15.260402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d1d1-86f8-4cc8-8677-529c345b0cf5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.267620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.270013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.270321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.270638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.271570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.273637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70ba32-7a36-40bd-bf6a-36993e354b71 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.288373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1063/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:15.292651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.304795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96511102-ec4e-4c06-8b9d-aa9ae524516f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.309766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.310450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.310739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.311023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] PATH_INFO: `/v3/projects/1ba3d83990224cccbcbb6cc45ff62693/users/5bd4fb7204a24469b96812d2c764f78e/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.329552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba3d83990224cccbcbb6cc45ff62693, user_id=5bd4fb7204a24469b96812d2c764f78e, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.333064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.353691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1066/2129] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:15 2022] PUT /identity/v3/projects/1ba3d83990224cccbcbb6cc45ff62693/users/5bd4fb7204a24469b96812d2c764f78e/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:15.359363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26e6d-05a8-4761-9be5-ef971e73119b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.359643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26e6d-05a8-4761-9be5-ef971e73119b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.360776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26e6d-05a8-4761-9be5-ef971e73119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.387809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f3e26e6d-05a8-4761-9be5-ef971e73119b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:15.389108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f3e26e6d-05a8-4761-9be5-ef971e73119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:15.454476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1064/2130] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:15.464353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:15.466099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:15.542137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb753-0550-460e-b6b8-c2061dc9950c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:15.545957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:15.546603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:15.546878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:15.547159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:15.557088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:15.558565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:15.568906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1067/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:05:17.094817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7e79-484a-4f1d-9be6-f2dd2f513343 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:17.095323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7e79-484a-4f1d-9be6-f2dd2f513343 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:17.096983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7e79-484a-4f1d-9be6-f2dd2f513343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:17.141382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f66f7e79-484a-4f1d-9be6-f2dd2f513343 None None] MFA Rules not processed for user `5bd4fb7204a24469b96812d2c764f78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:17.142975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f66f7e79-484a-4f1d-9be6-f2dd2f513343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:17.301341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1065/2132] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:17.311920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:17.313951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:17.405898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb38b5-e87c-470a-a1a0-6c49c6385b16 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:17.415097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:17.415748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:17.416036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:17.416324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:17.427935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:17.430036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:17.445938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1068/2133] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:18.940439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:18.941020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:18.941255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:18.963127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] MFA Rules not processed for user `5bd4fb7204a24469b96812d2c764f78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:18.964345 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:18.976502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1066/2134] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:27.438089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:28.239441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:28.241889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:28.258755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28abe-ff1d-4de2-8ca7-c5faec0d518e service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:28.263972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:28.265042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:28.265558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:28.266050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] PATH_INFO: `/v3/users/2313edf687ee43eeaa2d0f536a4690f9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:28.267449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2313edf687ee43eeaa2d0f536a4690f9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:28.270136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:28.333258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2313edf687ee43eeaa2d0f536a4690f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.344177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2313edf687ee43eeaa2d0f536a4690f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.345052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2313edf687ee43eeaa2d0f536a4690f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.362137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2313edf687ee43eeaa2d0f536a4690f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.362989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2313edf687ee43eeaa2d0f536a4690f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.377666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1069/2135] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:28 2022] DELETE /identity/v3/users/2313edf687ee43eeaa2d0f536a4690f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:28.777101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:28.792459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51c807-f32c-4de1-ad77-31af5c946e3d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:28.871485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:28.872137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:28.872420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:28.872694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] PATH_INFO: `/v3/projects/22558a8d8b0f440fa7b8ef618a457560` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:28.873879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22558a8d8b0f440fa7b8ef618a457560)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:28.875797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:28.899574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:28.939349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22558a8d8b0f440fa7b8ef618a457560', 'request_id': 'req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.951807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22558a8d8b0f440fa7b8ef618a457560', 'request_id': 'req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.959532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22558a8d8b0f440fa7b8ef618a457560', 'request_id': 'req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.973733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] The token cache is being invalidate because project 22558a8d8b0f440fa7b8ef618a457560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:28.974035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.974705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:28.976515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1067/2136] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:28 2022] DELETE /identity/v3/projects/22558a8d8b0f440fa7b8ef618a457560 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:28.980486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:28.982007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:28.997591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c26aa-0e65-4778-a546-92aa7243f7e2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:29.064654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:29.067298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.067298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.067298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] PATH_INFO: `/v3/users/64311bf8ebbf460fa0b8f47c0d9e0401` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.068999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64311bf8ebbf460fa0b8f47c0d9e0401)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:29.071623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:29.130948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64311bf8ebbf460fa0b8f47c0d9e0401'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.139561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64311bf8ebbf460fa0b8f47c0d9e0401'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.140287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64311bf8ebbf460fa0b8f47c0d9e0401'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.153694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64311bf8ebbf460fa0b8f47c0d9e0401'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.155067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1b43a98-d86a-47a0-82ce-87759d1b9b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64311bf8ebbf460fa0b8f47c0d9e0401'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.159118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:29.175245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1070/2137] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:28 2022] DELETE /identity/v3/users/64311bf8ebbf460fa0b8f47c0d9e0401 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:29.364912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:29.366977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:29.392966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd8ffb-19e3-49dc-ab9d-a9c27d625c93 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:29.516840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:29.517829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.517974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.518151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] PATH_INFO: `/v3/projects/9cc5018a45484c2582d4860e77f29de1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.520053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc5018a45484c2582d4860e77f29de1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:29.522648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:29.582267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc5018a45484c2582d4860e77f29de1', 'request_id': 'req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.603330 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc5018a45484c2582d4860e77f29de1', 'request_id': 'req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.610726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc5018a45484c2582d4860e77f29de1', 'request_id': 'req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.622873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] The token cache is being invalidate because project 9cc5018a45484c2582d4860e77f29de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:29.623151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.624042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c6c3b614-0c19-4d6e-817f-ed1b81caeca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:29.625967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1068/2138] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:29 2022] DELETE /identity/v3/projects/9cc5018a45484c2582d4860e77f29de1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:29.632482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.632885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.633253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.657175 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:29.658934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:29.739750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1071/2139] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:29.747873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.748161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.748442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.769903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:29.771206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:29.782374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1069/2140] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:29.786868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:29.798134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b927-1eca-469f-be0d-13554ddeb644 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:29.803936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:29.804670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.805049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.805421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.806189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:29.806576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:29.808231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:29.827400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1072/2141] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:05:29.829322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:29.841740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629b645-6340-46d3-a2fb-5423b130ea74 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:29.848792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:29.849540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:29.849830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:29.850260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:29.851134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:29.853609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:29.927314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1070/2142] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:29 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:29.928930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:29.948146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570bb5-4dfc-42a6-949b-80326df66c25 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.050508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.051288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.051676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.052080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.052893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.058378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.117159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1073/2143] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:29 2022] POST /identity/v3/users => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:30.122185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:30.143601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f2ba1-7a53-4df8-a7ef-b03bb5a39786 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.155956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.160887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.161291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.161657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.162970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.169031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.172717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:30.203651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:30.204297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1071/2144] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:30.221150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4b58-3d8c-4117-a43b-33d690d81aab admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.235036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.237958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.238547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.239218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.240432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.242687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30920c-d647-4b4d-bdf7-6c778df0dc24 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.277183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1074/2145] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:30.281554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:30.308448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff013a-49d2-439d-bb60-68f38270fefa admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.324110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.324826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.325113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.325422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] PATH_INFO: `/v3/projects/2ee4cea9868447228e986d9e2dbb2b7a/users/b468d1c273da4d188903647980f89727/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.348356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee4cea9868447228e986d9e2dbb2b7a, user_id=b468d1c273da4d188903647980f89727, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.352419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.375414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1072/2146] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:30 2022] PUT /identity/v3/projects/2ee4cea9868447228e986d9e2dbb2b7a/users/b468d1c273da4d188903647980f89727/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:05:30.387648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.388572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.389550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.438478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] MFA Rules not processed for user `b468d1c273da4d188903647980f89727`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:30.439846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:30.517015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:30.564018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1075/2147] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:30.698625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:30.700430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:30.803866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd92d94-c92a-46be-9863-866a3209eaf9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.810973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.812216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.812508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.812787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.827156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.830576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fd1c0-1e44-4dd3-9bee-2c529a434ffa service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.852074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1073/2148] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:30.869027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:30.931623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23d49b-8870-43f7-9b35-153e48652a02 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:30.936079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:30.936714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:30.936994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:30.937292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] PATH_INFO: `/v3/users/b468d1c273da4d188903647980f89727` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:30.938442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b468d1c273da4d188903647980f89727)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:30.940886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:30.986441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b468d1c273da4d188903647980f89727'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:30.993427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b468d1c273da4d188903647980f89727'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:30.994063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b468d1c273da4d188903647980f89727'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.006539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b468d1c273da4d188903647980f89727'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.007195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b468d1c273da4d188903647980f89727'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.019806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1076/2149] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:30 2022] DELETE /identity/v3/users/b468d1c273da4d188903647980f89727 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:31.024280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.024639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.024927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.043722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:31.044904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:31.102410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1074/2150] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:31.112282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.113377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:31.177943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288bbdd-ca39-47bb-b1bd-157fe3db7394 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.181670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.182302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.182587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.182865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.192520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.193990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7e26-3c18-4c5b-b33c-b408940d4302 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.203523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1077/2151] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:31.472747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.474297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:31.491477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b7f1-4ecf-4c51-8b5d-382f8ef28e30 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.499004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.499711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.499995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.500272 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] PATH_INFO: `/v3/projects/2ee4cea9868447228e986d9e2dbb2b7a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.501710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee4cea9868447228e986d9e2dbb2b7a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.504572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.551318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee4cea9868447228e986d9e2dbb2b7a', 'request_id': 'req-507654d1-28ea-482e-81b4-c7f2b9adb193'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.560755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee4cea9868447228e986d9e2dbb2b7a', 'request_id': 'req-507654d1-28ea-482e-81b4-c7f2b9adb193'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.568186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee4cea9868447228e986d9e2dbb2b7a', 'request_id': 'req-507654d1-28ea-482e-81b4-c7f2b9adb193'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.576208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:31.580153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] The token cache is being invalidate because project 2ee4cea9868447228e986d9e2dbb2b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:31.580497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.581612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-507654d1-28ea-482e-81b4-c7f2b9adb193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:31.583363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1075/2152] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:31 2022] DELETE /identity/v3/projects/2ee4cea9868447228e986d9e2dbb2b7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:31.589161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.589617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.589841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.609854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:31.611071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:31.615943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:31.678777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1078/2153] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:31.686823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.687107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.687383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.707129 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:31.708402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:31.718035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1076/2154] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:31.722865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.733085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24adc3-32ac-4efc-9b92-890dd415c32e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.738499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.739122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.739411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.739694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.740400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:31.740733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.742329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.757203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1079/2155] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:05:31.758350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.769156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1fa0-df3e-47b7-abad-2a38284b5100 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.772715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.773358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.773654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.773936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.774608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.776526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.807114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1077/2156] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:31 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:31.811083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.821594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228fb25-9da5-4031-8c40-2918f5cde086 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.886283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.886283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.886283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.886283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.886732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.886732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.912999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1080/2157] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:31 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:31.914471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.926014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4d320-14be-48f4-b1f4-18c829209964 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.932183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.932973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.933374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.933723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.934634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.936321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.947544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1078/2158] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:31.951269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.963337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c49fe-cc48-47ce-a0b0-5ea3d4aaf535 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:31.968429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:31.969373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:31.969633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:31.969921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:31.971777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:31.972997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7faf3d-d079-4b73-9f65-c5418a7b209c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:31.984794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1081/2159] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:31.989398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:31.999891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194be97-d74d-4945-b2df-04defbbaa4ca admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:32.005437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:32.006240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:32.006533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:32.006817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] PATH_INFO: `/v3/projects/216bdcedbde64e2abd4331ace3150d42/users/1f87f5ee713847e2b89bccdf5f5038a1/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:32.024409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216bdcedbde64e2abd4331ace3150d42, user_id=1f87f5ee713847e2b89bccdf5f5038a1, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:32.027156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:32.051674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1079/2160] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:31 2022] PUT /identity/v3/projects/216bdcedbde64e2abd4331ace3150d42/users/1f87f5ee713847e2b89bccdf5f5038a1/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:05:32.063197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:32.063490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:32.063774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:32.093345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] MFA Rules not processed for user `1f87f5ee713847e2b89bccdf5f5038a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:32.094742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:32.165143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1082/2161] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:32.177142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:32.178896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:32.234410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8a83-85cd-4bd6-914a-489eefe639b0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:32.237969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:32.238888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:32.239190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:32.239468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:32.247525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:32.248938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86df47-18ff-40e7-8046-819dd4162f59 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:32.260076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1080/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:34.824622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:34.829882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:34.890437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a19b-5ea1-4496-9b92-a561664a74a3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:34.895681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:34.896330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:34.896616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:34.896898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] PATH_INFO: `/v3/users/1f87f5ee713847e2b89bccdf5f5038a1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:34.898123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f87f5ee713847e2b89bccdf5f5038a1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:34.900045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:34.944910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f87f5ee713847e2b89bccdf5f5038a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:34.952208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f87f5ee713847e2b89bccdf5f5038a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:34.952802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f87f5ee713847e2b89bccdf5f5038a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:34.964564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f87f5ee713847e2b89bccdf5f5038a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:34.965207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f87f5ee713847e2b89bccdf5f5038a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:34.977356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1083/2163] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:34 2022] DELETE /identity/v3/users/1f87f5ee713847e2b89bccdf5f5038a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:34.981924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:34.982407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:34.982507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.001675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:35.003423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:35.063236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1081/2164] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:35.074017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.075510 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:35.132542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354fe5-25f3-475c-9d55-a77c5020e1e0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.136305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.136929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.137286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.137542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.146652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.148092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d93a19-4660-40d6-8a35-57f8861018cb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.159132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1084/2165] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:35.431291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.432518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:35.444659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1ef97-7dc3-4967-8eef-3b3f805da220 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.451102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.451776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.452046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.452334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] PATH_INFO: `/v3/projects/216bdcedbde64e2abd4331ace3150d42` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.453556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216bdcedbde64e2abd4331ace3150d42)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.455652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.495407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:35.509924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216bdcedbde64e2abd4331ace3150d42', 'request_id': 'req-2da1684a-957d-4f65-8d1f-a4256aab46e8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:35.517961 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216bdcedbde64e2abd4331ace3150d42', 'request_id': 'req-2da1684a-957d-4f65-8d1f-a4256aab46e8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:35.524860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216bdcedbde64e2abd4331ace3150d42', 'request_id': 'req-2da1684a-957d-4f65-8d1f-a4256aab46e8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:35.538153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] The token cache is being invalidate because project 216bdcedbde64e2abd4331ace3150d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:35.538449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:35.540340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2da1684a-957d-4f65-8d1f-a4256aab46e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:35.545798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1082/2166] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:35 2022] DELETE /identity/v3/projects/216bdcedbde64e2abd4331ace3150d42 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:35.546428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.546832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.547124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.570055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:35.571412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:35.594672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:35.648139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1085/2167] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:35.655811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.656100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.656382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.677815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:35.679082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:35.691169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1083/2168] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:35.692862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.706647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe725f-8e8b-484f-96da-8e2d3d7ef153 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.713227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.713891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.714524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.714524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.715149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:35.715462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.717089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.733320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1086/2169] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:05:35.735354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.744761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9c799-288e-4c8d-9ac5-89d0e2a73cce None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.749617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.750144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.750592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.750856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.751714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.753947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.787337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1084/2170] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:35 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:35.791421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.802491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84f706-d7af-4d0d-a7d9-5e44c2211448 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.862642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.863290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.863676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.863964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.864642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.866664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.888893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1087/2171] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:35 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:05:35.893671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.904311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2a036-2d9b-4067-bb61-d151e5c699c4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.910304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.910919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.911199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.911472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.912193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.913897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.923877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1085/2172] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:35.927776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.937754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27c41-f1a3-448b-8a03-62dadf61f1e3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.942460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.943061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.943344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.943629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.944306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.945941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f513c1-a6c5-4ef2-94ce-d421e9de141d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:35.956826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1088/2173] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:35.960886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:35.971372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014bae7-4563-4b35-a2a9-5734ee5a66e6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:35.976029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:35.976687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:35.976968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:35.977245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] PATH_INFO: `/v3/projects/6b93a32ac3fe4af89e4bf4bdaed0c272/users/38da90e025c84f7a8683c95fadd000e6/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:35.992161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b93a32ac3fe4af89e4bf4bdaed0c272, user_id=38da90e025c84f7a8683c95fadd000e6, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:35.995127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:36.008438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1086/2174] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:35 2022] PUT /identity/v3/projects/6b93a32ac3fe4af89e4bf4bdaed0c272/users/38da90e025c84f7a8683c95fadd000e6/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:36.013479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb762-049f-4400-b8aa-a29972ef9954 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:36.013791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb762-049f-4400-b8aa-a29972ef9954 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:36.014071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb762-049f-4400-b8aa-a29972ef9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:36.034514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e76eb762-049f-4400-b8aa-a29972ef9954 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:36.035912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e76eb762-049f-4400-b8aa-a29972ef9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:36.097420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1089/2175] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:36.107069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:36.108796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:36.165725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66782a-688f-4c43-94b2-ce6167fef904 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:36.169426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:36.170053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:36.170339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:36.170617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:36.179747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:36.181184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:36.191230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1087/2176] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:37.288439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be910-1d64-41c8-9717-f426f1213d0e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:37.288958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be910-1d64-41c8-9717-f426f1213d0e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:37.289071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95be910-1d64-41c8-9717-f426f1213d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:37.321648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f95be910-1d64-41c8-9717-f426f1213d0e None None] MFA Rules not processed for user `38da90e025c84f7a8683c95fadd000e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:37.322967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f95be910-1d64-41c8-9717-f426f1213d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:37.346609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:37.408715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1090/2177] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:37.419881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:37.421466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:37.484889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a25d-3503-41b3-ae6d-1b6290624185 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:37.489324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:37.490289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:37.490581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:37.490866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:37.501115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:37.503166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bdc1b-ac84-4e99-b29d-f3256220342c service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:37.514363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1088/2178] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:37.881782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:37.882129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:37.882421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:37.901923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] MFA Rules not processed for user `5bd4fb7204a24469b96812d2c764f78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:37.903131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:37.959183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1091/2179] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:38.944477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46383533-ee63-427d-be96-69817bac26dd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:38.945026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46383533-ee63-427d-be96-69817bac26dd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:38.945026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46383533-ee63-427d-be96-69817bac26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:38.953233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:38.965835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-46383533-ee63-427d-be96-69817bac26dd None None] MFA Rules not processed for user `38da90e025c84f7a8683c95fadd000e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:38.967280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-46383533-ee63-427d-be96-69817bac26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:38.975245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1089/2180] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:40.330093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:40.332619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:40.347432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b494-28cb-41e2-b74c-b1ce76c882eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:40.352388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:40.353039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:40.353358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:40.353634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] PATH_INFO: `/v3/users/fb872ee32a634f70a828a2456066449d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:40.355338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb872ee32a634f70a828a2456066449d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:40.357461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:40.409166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb872ee32a634f70a828a2456066449d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:40.418662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb872ee32a634f70a828a2456066449d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:40.423420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb872ee32a634f70a828a2456066449d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:40.435748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb872ee32a634f70a828a2456066449d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:40.436445 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb872ee32a634f70a828a2456066449d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:40.452270 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1092/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:05:40 2022] DELETE /identity/v3/users/fb872ee32a634f70a828a2456066449d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:40.454016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:40.455022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:40.455148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:40.475360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:40.476563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:40.542238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1090/2182] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:40.551890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:40.553319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:40.596658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:40.612220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a41a7-989f-434f-81ac-375ec77bd947 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:40.615878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:40.616496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:40.616782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:40.617058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:40.627813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:40.629247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b384a-e19e-4e4d-af56-f0c2eb7eb862 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:40.638794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1093/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:41.453511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:41.455574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:41.468395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b945-dbc1-476e-9f07-46657398fe33 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:41.474009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:41.474768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.474965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.475477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] PATH_INFO: `/v3/projects/0a65a50d88054742bc5f01d27afa39f4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.477019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a65a50d88054742bc5f01d27afa39f4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:41.479377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:41.552200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a65a50d88054742bc5f01d27afa39f4', 'request_id': 'req-b7977852-3dd4-46a9-8758-c960fd9aa1e2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:41.563007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a65a50d88054742bc5f01d27afa39f4', 'request_id': 'req-b7977852-3dd4-46a9-8758-c960fd9aa1e2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:41.575337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a65a50d88054742bc5f01d27afa39f4', 'request_id': 'req-b7977852-3dd4-46a9-8758-c960fd9aa1e2'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:41.589806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] The token cache is being invalidate because project 0a65a50d88054742bc5f01d27afa39f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:05:41.590308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:41.591154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7977852-3dd4-46a9-8758-c960fd9aa1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:05:41.594367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1091/2184] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:05:41 2022] DELETE /identity/v3/projects/0a65a50d88054742bc5f01d27afa39f4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:41.599224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.600055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.600476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.623513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:41.625123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:41.707520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1094/2185] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:05:41.715279 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.715515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.716161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.737398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:41.738677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:41.747662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1092/2186] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:41.752547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:41.764254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026a81a-846b-4882-9446-f49ef67b1123 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:41.768947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:41.769609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.769896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.770234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.770952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:05:41.771262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:41.772990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:41.796545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1095/2187] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:05:41.797884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:41.810594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9e497-c45e-43f9-9d2f-d81a52b3c8e7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:41.819958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:41.820804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.820972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.821234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.822200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:41.827786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:41.865423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1093/2188] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:05:41 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:41.866628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:41.877041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff82830-08c6-4c4c-9015-48831ebf6871 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:41.963048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:41.963193 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:41.963455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:41.963735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:41.964460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:41.966590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:41.994849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1096/2189] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:05:41 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:05:41.998985 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:42.009413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5a721-f7d8-47bb-a6c2-69612cff63e8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:42.014263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:42.014976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:42.015334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:42.015688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:42.016489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:42.018776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:42.029508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1094/2190] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:42.034555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:42.046488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f77c-b4e2-4c34-a7d6-c7bb7bd4e708 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:42.051465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:42.052225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:42.052592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:42.052935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:42.053669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:42.055264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086319a5-d74b-4592-9c3a-f55ff38032a0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:42.066964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1097/2191] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:05:42.070935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:42.081584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beb0f3-ee1d-471a-9568-279479412e60 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:42.086106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:42.086762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:42.087044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:42.087319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] PATH_INFO: `/v3/projects/99ddd9ebebb443a79c5aeeff6085783e/users/e38ca34c6dcd4d44b547463fb3b6b7e4/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:42.101469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ddd9ebebb443a79c5aeeff6085783e, user_id=e38ca34c6dcd4d44b547463fb3b6b7e4, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:42.104106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:42.116652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1095/2192] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:05:42 2022] PUT /identity/v3/projects/99ddd9ebebb443a79c5aeeff6085783e/users/e38ca34c6dcd4d44b547463fb3b6b7e4/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:05:42.128107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cd44-34e7-4bfc-9b1f-1830fd21502d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:42.128396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cd44-34e7-4bfc-9b1f-1830fd21502d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:42.128698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2cd44-34e7-4bfc-9b1f-1830fd21502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:42.156238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ab2cd44-34e7-4bfc-9b1f-1830fd21502d None None] MFA Rules not processed for user `e38ca34c6dcd4d44b547463fb3b6b7e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:05:42.158374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ab2cd44-34e7-4bfc-9b1f-1830fd21502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:42.201449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:42.232630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1098/2193] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:05:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:05:42.244258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:05:42.246080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:05:42.265884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:42.304412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac132f6-6ced-4760-b7a2-8daa5111ec83 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:05:42.308079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:05:42.308698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:05:42.308977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:05:42.309251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:05:42.317542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:05:42.318971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d6d1-0362-4081-b24c-11ff8006fef7 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:05:42.327640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1096/2194] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:05:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:05:52.228901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:52.323668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=18 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:05.173925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:05.174477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:05.174477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:05.194179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] MFA Rules not processed for user `7f7ce4ba826f4ed3911e14eae34f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:05.195532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:05.251109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1099/2195] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:12.936971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6265-87c3-44e3-a95d-9db99dd1aa36 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:12.937537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6265-87c3-44e3-a95d-9db99dd1aa36 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:12.937537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b6265-87c3-44e3-a95d-9db99dd1aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:12.962878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-092b6265-87c3-44e3-a95d-9db99dd1aa36 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:12.964169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-092b6265-87c3-44e3-a95d-9db99dd1aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:13.061062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1097/2196] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:06:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:13.105447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:13.107382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:13.189234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d49cf-595b-4c92-9c1f-fab8bc5f4fbb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:13.196889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:13.197566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:13.197856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:13.198141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:13.207697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:13.209450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:13.218877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1100/2197] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:06:16.474514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:16.475137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:16.475780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:16.525910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:16.527434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:16.537049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1098/2198] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:16.571980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:16.588359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4806-3432-4ea6-a1fb-d637536784ed service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:16.602858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:16.604723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:16.605252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:16.605862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:16.622656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:16.626111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399219e-2afd-4891-813a-8d7ca8ec54b0 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:16.640998 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1101/2199] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:06:24.597832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:24.714665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6d06-db22-4b24-8e36-72c5ad110829 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:24.720103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:24.725583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:24.726083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:24.727406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] PATH_INFO: `/v3/users/e38ca34c6dcd4d44b547463fb3b6b7e4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:24.730580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38ca34c6dcd4d44b547463fb3b6b7e4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:24.736033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:24.862140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38ca34c6dcd4d44b547463fb3b6b7e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:24.878267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38ca34c6dcd4d44b547463fb3b6b7e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:24.880276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38ca34c6dcd4d44b547463fb3b6b7e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:24.881172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38ca34c6dcd4d44b547463fb3b6b7e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:24.911321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38ca34c6dcd4d44b547463fb3b6b7e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:24.936914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1099/2200] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:06:24 2022] DELETE /identity/v3/users/e38ca34c6dcd4d44b547463fb3b6b7e4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:24.939846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:24.940912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:24.940994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:24.986016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:24.987277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:25.200345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1102/2201] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:25.208067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:25.210527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:25.252782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:25.304860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2845b2-435a-4a25-b8c8-65990dc50067 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:25.311662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:25.312591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:25.313086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:25.313603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:25.330981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:25.333246 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec501f1-ad20-422b-84dd-82e2ea2a4a3d service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:25.365856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1100/2202] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:25.897213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:25.899169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:25.913904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5b53-3947-426f-8b8b-df7bdc6e6135 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:25.919021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:25.920041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:25.920516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:25.920984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] PATH_INFO: `/v3/projects/99ddd9ebebb443a79c5aeeff6085783e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:25.926167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ddd9ebebb443a79c5aeeff6085783e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:25.928126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:25.947364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:25.997725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ddd9ebebb443a79c5aeeff6085783e', 'request_id': 'req-5cce76b0-046f-4829-b90d-80899b1d855a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:26.007492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ddd9ebebb443a79c5aeeff6085783e', 'request_id': 'req-5cce76b0-046f-4829-b90d-80899b1d855a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:26.016582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ddd9ebebb443a79c5aeeff6085783e', 'request_id': 'req-5cce76b0-046f-4829-b90d-80899b1d855a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:26.029431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] The token cache is being invalidate because project 99ddd9ebebb443a79c5aeeff6085783e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:06:26.029719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:26.030382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5cce76b0-046f-4829-b90d-80899b1d855a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:26.033312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1103/2203] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:06:25 2022] DELETE /identity/v3/projects/99ddd9ebebb443a79c5aeeff6085783e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:26.037292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.037789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.037907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.082252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:26.083641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:26.185407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1101/2204] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:26.186899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.187192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.187611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.226159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:26.227701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:26.257628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1104/2205] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:26.262651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.277056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf952-aeea-4fd9-87e7-8af1dd8a9f05 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.301557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.302653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.305297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.305297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.306502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:06:26.306502 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.308214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.339070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1102/2206] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:06:26.340210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.353748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531a421-d56c-4fc7-90f0-a57e95b8ef80 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.367596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.371868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.372896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.373211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.374033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.378659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.414593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1105/2207] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:06:26 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:06:26.418642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.438410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba724f-92bc-48c1-8694-9171b09b0fa9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.515688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.516645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.517027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.517336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.518223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.520489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.573578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1103/2208] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:06:26 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:06:26.574903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.589208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdcbbb-e42a-4553-a41a-c06dadaf7b3d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.598897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.601109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.604520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.605460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.609041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.618448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.650960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.652487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1106/2209] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:06:26.668647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2336e-d729-40c6-abda-530ce0a3c0cf admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.677535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.678192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.678466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.678760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.679451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.681080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ffe2d-7ea8-481d-a25d-e05b6009d548 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.719959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1104/2210] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:06:26.721151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.736461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d811a37-4674-40f9-acbc-8f847325627d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:26.747544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:26.747544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.747874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.748126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] PATH_INFO: `/v3/projects/44c53141136b4093a66e06688946dbf6/users/65f75cc16e8f4c92b61f24d6373473ac/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.783835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c53141136b4093a66e06688946dbf6, user_id=65f75cc16e8f4c92b61f24d6373473ac, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:26.786522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:26.813946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1107/2211] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:06:26 2022] PUT /identity/v3/projects/44c53141136b4093a66e06688946dbf6/users/65f75cc16e8f4c92b61f24d6373473ac/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:26.826628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d9b5-4b0e-4092-82ef-4ed6022d4b2b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:26.827049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d9b5-4b0e-4092-82ef-4ed6022d4b2b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:26.827411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d9b5-4b0e-4092-82ef-4ed6022d4b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:26.867917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3733d9b5-4b0e-4092-82ef-4ed6022d4b2b None None] MFA Rules not processed for user `65f75cc16e8f4c92b61f24d6373473ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:26.870334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3733d9b5-4b0e-4092-82ef-4ed6022d4b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:26.885343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:26.978144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1105/2212] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:06:26.988528 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:26.991849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:27.114575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f008b-2cb0-44db-862c-f7477bf67cc1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:27.138517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:27.139220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:27.139464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:27.139746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:27.150070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:27.151944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa295e-febd-4ea7-9a39-9d4dfbea5c68 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:27.180693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1108/2213] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:33.774071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aafa-bbee-45ed-a735-83cb148a0c47 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:33.774971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aafa-bbee-45ed-a735-83cb148a0c47 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:33.775255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4aafa-bbee-45ed-a735-83cb148a0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:33.841305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-afb4aafa-bbee-45ed-a735-83cb148a0c47 None None] MFA Rules not processed for user `dd02eac802ef4cfb81f8670124bc894f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:33.841545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-afb4aafa-bbee-45ed-a735-83cb148a0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:33.982449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1106/2214] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:36.352840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:36.353777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:36.354320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:36.356477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1109/2215] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:06:36.365462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc34e7-bd6b-430b-a097-6dff8110d7da None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:36.366021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc34e7-bd6b-430b-a097-6dff8110d7da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:36.366105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc34e7-bd6b-430b-a097-6dff8110d7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:36.387120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5bcc34e7-bd6b-430b-a097-6dff8110d7da None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:36.388965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5bcc34e7-bd6b-430b-a097-6dff8110d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:36.478297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1107/2216] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:06:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:36.490847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:36.492662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:36.602927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:36.619612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe0e87-2bc7-43f0-97e9-c43ef73362ce None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:36.624344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:36.625392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:36.626497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:36.637299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:36.667379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:36.672255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43811a-4cd6-4a09-aa18-090eb963aff0 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:36.696258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1110/2217] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:06:36.831075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:36.832086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:36.832614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:36.834398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1108/2218] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:06:36.839928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cc0d9-343d-421d-9d4d-38530eba43c1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:36.840245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cc0d9-343d-421d-9d4d-38530eba43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:36.841699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cc0d9-343d-421d-9d4d-38530eba43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:36.882326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f69cc0d9-343d-421d-9d4d-38530eba43c1 None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:36.884003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f69cc0d9-343d-421d-9d4d-38530eba43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:36.972127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1111/2219] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:06:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:36.990301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:36.992624 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:37.011442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f21e4-f559-46f1-8cfc-d676568efb30 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:37.016429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:37.017392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.017891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.018357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:37.028853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:37.030791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db643600-e9b0-4934-8ec7-af666dd7d9c6 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:37.044338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1109/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:37.154738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.155104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.155396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:37.157086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1112/2221] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:06:37.165420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2803e-7275-4698-9c61-3c767aeb6da6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.166240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2803e-7275-4698-9c61-3c767aeb6da6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.166550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2803e-7275-4698-9c61-3c767aeb6da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:37.263223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f3a2803e-7275-4698-9c61-3c767aeb6da6 None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:37.265157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f3a2803e-7275-4698-9c61-3c767aeb6da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:37.321403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1110/2222] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:06:37.335016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:37.338246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:37.370159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5165-5030-4963-8acc-a7391d3f5da5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:37.379735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:37.380499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.380787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.381062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:37.404151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:37.405829 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:37.418708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1113/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:37.809400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.809903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.809988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:37.832365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:37.833906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:37.885581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:37.930872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1111/2224] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:37.966118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:37.968062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:37.986012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9862d-d8bf-4ed4-895f-0daff2bb82eb service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:37.996113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:37.996941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:37.997543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:37.998092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:38.009043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:38.011901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5806a-17b0-4b61-90dd-e01a94db667f service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:38.026799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1114/2225] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:39.737871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:39.748888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec35d-afe0-4c48-839e-3db511dd24cf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:39.755137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:39.755879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:39.756169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:39.756440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] PATH_INFO: `/v3/users/65f75cc16e8f4c92b61f24d6373473ac` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:39.757955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f75cc16e8f4c92b61f24d6373473ac)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:39.759933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:39.837436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f75cc16e8f4c92b61f24d6373473ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:39.848765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f75cc16e8f4c92b61f24d6373473ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:39.849568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f75cc16e8f4c92b61f24d6373473ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:39.853714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f75cc16e8f4c92b61f24d6373473ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:39.875050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f89e7d84-e11f-4ae2-bac9-ccd83170c754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f75cc16e8f4c92b61f24d6373473ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:39.900563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1112/2226] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:06:39 2022] DELETE /identity/v3/users/65f75cc16e8f4c92b61f24d6373473ac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:39.905484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:39.906651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:39.907654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:39.976869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:39.980424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:40.167821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:40.168460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:40.169004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:40.202416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1115/2227] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:06:40.214074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:40.215515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:40.227739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:40.233204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:40.328843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e04a9-5a08-4bbb-8674-b3aa0d039dc6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:40.338051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:40.338769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:40.339056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:40.339328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:40.370439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:40.374293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:40.397908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1116/2228] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:06:40.402417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1113/2229] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:40.418281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:40.420296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:40.436691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:40.505712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cae16-c6c7-440f-a1ec-d50205e79093 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:40.513113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:40.513554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:40.513831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:40.514113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:40.523304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:40.525002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664849-a41a-42b9-9390-3bbe2cb49eb0 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:40.534448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1117/2230] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:06:40.827231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:40.828792 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:40.855187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b0057-c1e5-4288-a64b-9b31c09805fb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:40.860916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:40.861891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:40.862431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:40.863469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] PATH_INFO: `/v3/projects/44c53141136b4093a66e06688946dbf6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:40.864977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c53141136b4093a66e06688946dbf6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:40.868243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:40.942461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:40.946038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c53141136b4093a66e06688946dbf6', 'request_id': 'req-e68307fb-9772-4333-837d-a16a0859fec8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:40.959327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c53141136b4093a66e06688946dbf6', 'request_id': 'req-e68307fb-9772-4333-837d-a16a0859fec8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:40.967600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c53141136b4093a66e06688946dbf6', 'request_id': 'req-e68307fb-9772-4333-837d-a16a0859fec8'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:40.982079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] The token cache is being invalidate because project 44c53141136b4093a66e06688946dbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:06:40.982477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:40.984013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-e68307fb-9772-4333-837d-a16a0859fec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:40.986598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1114/2231] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:06:40 2022] DELETE /identity/v3/projects/44c53141136b4093a66e06688946dbf6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:40.991676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:40.992509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:40.992940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.013821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:41.015234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:41.083730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1118/2232] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:41.091802 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.092061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.092316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.114962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:41.116532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:41.130560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1115/2233] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:41.131732 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.147861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9cd13-feb9-45b1-8a54-91dcecd363d0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.161837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.162762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.163590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.163590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.164195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:06:41.164721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.166704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.186152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1119/2234] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:06:41.191411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.200891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51418-10e0-41fc-8e55-3203fbfa026d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.205794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.206422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.206740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.207036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.208320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.210328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.246630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1116/2235] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:06:41.247723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.259590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0c5bb-f83a-4a64-80e0-da383704ee5f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.337003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.338603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.338603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.338603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.339219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.341919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.369910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1120/2236] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:06:41 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:06:41.382405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.412538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015875-b400-433c-9391-ffabfa43bcd4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.418846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.419481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.419810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.420093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.420797 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.422548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.439247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1117/2237] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:06:41.442971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.454707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5339b-5946-4f93-bd2e-272e48895304 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.460993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.461697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.461996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.462274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.462983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.464907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51923597-cf39-4cce-bd9f-76f4a92ba554 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.478125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1121/2238] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:06:41.482136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.493958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5c56b-4d72-45cc-aeb4-0fc4a7b804bf admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.499540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.500339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.500635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.501075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] PATH_INFO: `/v3/projects/a4b0dc5e930a4a19899927a2a376aba0/users/74a49f3bba1f4925a1edc3ad9f7ab53e/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.526605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b0dc5e930a4a19899927a2a376aba0, user_id=74a49f3bba1f4925a1edc3ad9f7ab53e, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.529087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.558679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1118/2239] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:06:41 2022] PUT /identity/v3/projects/a4b0dc5e930a4a19899927a2a376aba0/users/74a49f3bba1f4925a1edc3ad9f7ab53e/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:41.622907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.623667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.623667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.648423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:41.660342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] MFA Rules not processed for user `74a49f3bba1f4925a1edc3ad9f7ab53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:41.661698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:41.731057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1122/2240] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:41.742371 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:41.744160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:41.801029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2126-8c48-4aad-bf59-94a1fcdc74bd admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:41.804760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:41.805403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:41.805688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:41.805965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:41.814800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:41.816224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeda05-476e-4032-ac98-07002caab064 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:41.824989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1119/2241] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:42.596719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:42.599025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:42.700313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab4b5-da4e-4911-93e9-f0f07833c730 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:42.705404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:42.706050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:42.706337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:42.706621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] PATH_INFO: `/v3/users/5bd4fb7204a24469b96812d2c764f78e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:42.707794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd4fb7204a24469b96812d2c764f78e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:42.709751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:42.759953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd4fb7204a24469b96812d2c764f78e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:42.768368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd4fb7204a24469b96812d2c764f78e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:42.769023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd4fb7204a24469b96812d2c764f78e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:42.782209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd4fb7204a24469b96812d2c764f78e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:42.782900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd4fb7204a24469b96812d2c764f78e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:42.797592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1123/2242] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:06:42 2022] DELETE /identity/v3/users/5bd4fb7204a24469b96812d2c764f78e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:42.820783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:42.821338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:42.821684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:42.844942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:42.846711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:42.926950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1120/2243] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:42.955192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:42.956661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:42.979220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:43.017967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.019639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.050047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13813f-3bbe-4ba9-942d-5fe6af5aafd1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.056861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.057931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.058413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.058757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] PATH_INFO: `/v3/projects/1ba3d83990224cccbcbb6cc45ff62693` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.060177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba3d83990224cccbcbb6cc45ff62693)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.062146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.062359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a451d-e233-4e4d-b1b6-5c6d1b1a671e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.070179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.070833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.071215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.071969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.074210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:43.083723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.085658 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a663-90cb-4a00-bfdd-72c9ebf8934e service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.101784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1124/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:43.126955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba3d83990224cccbcbb6cc45ff62693', 'request_id': 'req-80206697-f827-4c74-b681-3ee8952e58bd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:43.143901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba3d83990224cccbcbb6cc45ff62693', 'request_id': 'req-80206697-f827-4c74-b681-3ee8952e58bd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:43.157776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba3d83990224cccbcbb6cc45ff62693', 'request_id': 'req-80206697-f827-4c74-b681-3ee8952e58bd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:43.178230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] The token cache is being invalidate because project 1ba3d83990224cccbcbb6cc45ff62693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:06:43.178461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:43.195369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-80206697-f827-4c74-b681-3ee8952e58bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:43.199839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1121/2245] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:06:43 2022] DELETE /identity/v3/projects/1ba3d83990224cccbcbb6cc45ff62693 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:06:43.205506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0a04-dc8f-4672-892c-3b438a7a347f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.205808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0a04-dc8f-4672-892c-3b438a7a347f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.206094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0a04-dc8f-4672-892c-3b438a7a347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.227637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e5db0a04-dc8f-4672-892c-3b438a7a347f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:43.228991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e5db0a04-dc8f-4672-892c-3b438a7a347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.236132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.236419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.236708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.264834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] MFA Rules not processed for user `74a49f3bba1f4925a1edc3ad9f7ab53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:43.266145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.305371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1125/2246] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:43.308907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.309415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.309699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.327983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1122/2247] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:43.330054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:43.331282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.339273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1126/2248] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:06:43.343318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.354973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e0c43-936d-4fd6-abe7-cccc8ae64404 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.360203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.362271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.362548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.362820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.363519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:06:43.363822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.366566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.388988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1123/2249] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:06:43.390061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.399989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c271e5-3144-4c36-b811-0cf9939ad9ec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.404791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.405461 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.405747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.406034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.407586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.409706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.436843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1127/2250] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:06:43.440979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.451235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae94c2f-a0eb-472a-903d-a0902a3f1cb0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.510126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.510665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.510944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.511218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.511925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.514066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.537717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1124/2251] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:06:43.541659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.552852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3d63-b68b-4ddc-b057-fc0c98be9196 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.557646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.558268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.558558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.558840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.559537 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.561142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.572650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1128/2252] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:06:43.576553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.587586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addefb38-db79-4e86-883c-ebb5b7e378ec admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.592303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.592922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.593202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.593505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.594257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.595881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf008d7-eeef-4ca8-8bdd-911ac3f242b0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.606964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1125/2253] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:06:43.611274 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.621908 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595927ba-04ad-4925-b72e-5dae1ddba30c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.627140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.627955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.628110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.628389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] PATH_INFO: `/v3/projects/bcb34dd863584f98bec5aa69a45daee6/users/84a3534785e84e9b9c6567bff8af4788/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.645927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb34dd863584f98bec5aa69a45daee6, user_id=84a3534785e84e9b9c6567bff8af4788, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.648390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.683966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1129/2254] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:06:43 2022] PUT /identity/v3/projects/bcb34dd863584f98bec5aa69a45daee6/users/84a3534785e84e9b9c6567bff8af4788/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:06:43.695915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6db9-e066-4644-bb49-8c4242f7df65 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.696206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6db9-e066-4644-bb49-8c4242f7df65 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.696484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6db9-e066-4644-bb49-8c4242f7df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.710844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:43.733534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e1fa6db9-e066-4644-bb49-8c4242f7df65 None None] MFA Rules not processed for user `84a3534785e84e9b9c6567bff8af4788`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:43.736065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e1fa6db9-e066-4644-bb49-8c4242f7df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.812514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1126/2255] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:43.825212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:43.827019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:43.894271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:43.917443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56cba-23c1-494b-80d6-ba9ea9a9218f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:43.923959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:43.924586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:43.924870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:43.925148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:43.940606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:43.942114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:43.951135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1130/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:44.174251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:44.176662 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:44.177434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:44.212317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:44.215845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:44.319354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1127/2257] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:44.335685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:44.338832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:44.467230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327117d-3dc0-4df1-9084-9922c58d363f service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:44.472877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:44.473547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:44.473909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:44.474282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:44.484348 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:44.486050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f7add-921f-436f-b3a9-4429921b3ed0 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:44.496030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1131/2258] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:06:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:06:49.178963 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:49.265757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07d2ce-6521-4d1a-8234-17f22a23d3a4 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:49.271237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:49.272053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:49.272403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:49.272752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] PATH_INFO: `/v3/users/84a3534785e84e9b9c6567bff8af4788` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:49.274220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a3534785e84e9b9c6567bff8af4788)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:49.276504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:49.327260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:49.330842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a3534785e84e9b9c6567bff8af4788'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:49.339012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a3534785e84e9b9c6567bff8af4788'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:49.339779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a3534785e84e9b9c6567bff8af4788'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:49.340619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a3534785e84e9b9c6567bff8af4788'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:49.354950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a3534785e84e9b9c6567bff8af4788'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:49.383294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1128/2259] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:06:49 2022] DELETE /identity/v3/users/84a3534785e84e9b9c6567bff8af4788 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:49.387660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:49.388170 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:49.388267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:49.418974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:49.420558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:49.493649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1132/2260] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:49.513524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:49.513524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:49.572328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289d0d6-7cc5-4e5a-9b92-8a18bca5d667 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:49.576452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:49.577093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:49.577409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:49.577690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:49.588782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:49.590282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b72aba-6fc7-4e6c-9bc0-503f1c3dc04a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:49.602071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1129/2261] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:06:50.021253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:50.022750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:50.038960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fe6f9-f1aa-4695-aa24-53662b5d65d9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:50.044255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:50.044973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:50.046094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:50.046740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] PATH_INFO: `/v3/projects/bcb34dd863584f98bec5aa69a45daee6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:50.057767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb34dd863584f98bec5aa69a45daee6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:50.062633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:50.115874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb34dd863584f98bec5aa69a45daee6', 'request_id': 'req-0a523a9d-337b-4989-a727-634ecdac48a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:50.124415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb34dd863584f98bec5aa69a45daee6', 'request_id': 'req-0a523a9d-337b-4989-a727-634ecdac48a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:50.130935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb34dd863584f98bec5aa69a45daee6', 'request_id': 'req-0a523a9d-337b-4989-a727-634ecdac48a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:50.137252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:50.145002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] The token cache is being invalidate because project bcb34dd863584f98bec5aa69a45daee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:06:50.145346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:50.146354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:06:50.148579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1133/2262] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:06:50 2022] DELETE /identity/v3/projects/bcb34dd863584f98bec5aa69a45daee6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:06:59.564777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddaf9-62ff-44a0-9b1d-8a5ea091c140 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:59.565382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddaf9-62ff-44a0-9b1d-8a5ea091c140 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:59.565491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddaf9-62ff-44a0-9b1d-8a5ea091c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:59.584793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-544ddaf9-62ff-44a0-9b1d-8a5ea091c140 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:06:59.586314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-544ddaf9-62ff-44a0-9b1d-8a5ea091c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:59.652320 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1130/2263] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:06:59.673182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:06:59.674727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:06:59.758653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a523a9d-337b-4989-a727-634ecdac48a1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:06:59.764239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:06:59.764872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:06:59.765160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:06:59.765475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:06:59.774743 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:06:59.776493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:06:59.791136 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1134/2264] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:02.644522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:02.645053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:02.645171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:02.665557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:02.667038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:02.675338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1131/2265] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:02.704775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:02.706190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:02.721385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986ada-a8f4-4fdb-976f-e6d81670aa3f service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:02.727011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:02.727713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:02.728004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:02.728280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:02.736882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:02.738523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8784e-a750-44d1-8041-8a07e3d3cf93 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:02.748285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1135/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:04.167227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:04.168669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:04.229628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:04.246533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598ca3e-1e5d-4ac2-81be-1f9976bafd4b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:04.253515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:04.254153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:04.254430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:04.254703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:04.256503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:04.268445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:04.270063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:04.280176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1132/2267] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:06.714077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5da2-5bc3-4f49-92a7-c066446cd81b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:06.715475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5da2-5bc3-4f49-92a7-c066446cd81b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:06.715972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5da2-5bc3-4f49-92a7-c066446cd81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:06.739836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e6bd5da2-5bc3-4f49-92a7-c066446cd81b None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:06.741176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e6bd5da2-5bc3-4f49-92a7-c066446cd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:06.803183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1136/2268] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:06.816022 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:06.817544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:06.885419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a92c3b-810c-4914-93c4-f8315cee22c2 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:06.890368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:06.891603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:06.891898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:06.892170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:06.900306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:06.902025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:06.910453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1133/2269] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:07:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:07:07.872134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e77c-e270-48fc-9deb-f3f29066fea3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:07.872635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e77c-e270-48fc-9deb-f3f29066fea3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:07.872871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e77c-e270-48fc-9deb-f3f29066fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:07.895848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3607e77c-e270-48fc-9deb-f3f29066fea3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:07.897104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3607e77c-e270-48fc-9deb-f3f29066fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:07.906879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1137/2270] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:07.932977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:07.949684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778772-2ba4-49c3-b3e3-c3b834ab497f service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:07.959445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:07.960437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:07.961166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:07.961860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:07.973370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:07.975762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:07.990603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1134/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:12.074329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0dff-24ac-4f1d-b097-e76200326111 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:12.074840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0dff-24ac-4f1d-b097-e76200326111 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:12.074940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0dff-24ac-4f1d-b097-e76200326111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:12.094066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-46ec0dff-24ac-4f1d-b097-e76200326111 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:12.095750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-46ec0dff-24ac-4f1d-b097-e76200326111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:12.103498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1138/2272] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:12.124615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:12.135682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed86b5-5e65-4d70-8a6a-b131a7b8f879 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:12.141277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:12.141904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:12.142197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:12.142468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:12.150988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:12.152641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:12.163318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1135/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:22.088771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=73 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:22.158899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=50 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:27.111872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11addc18-0758-497f-b21e-19ee570cd525 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:27.112477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11addc18-0758-497f-b21e-19ee570cd525 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:27.112582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11addc18-0758-497f-b21e-19ee570cd525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:27.146770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-11addc18-0758-497f-b21e-19ee570cd525 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:27.148084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-11addc18-0758-497f-b21e-19ee570cd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:27.166028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1139/2274] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:27.190629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:27.202230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c5865-1da6-47a6-ac74-141050cdea38 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:27.208007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:27.208878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:27.209146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:27.209472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:27.218506 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:27.220722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:27.229659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1136/2275] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:07:27.809214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29927b1-e7f4-4c51-bef3-a055bc10ce9f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:27.809609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29927b1-e7f4-4c51-bef3-a055bc10ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:27.810017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29927b1-e7f4-4c51-bef3-a055bc10ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:27.830774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e29927b1-e7f4-4c51-bef3-a055bc10ce9f None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:27.832009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e29927b1-e7f4-4c51-bef3-a055bc10ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:27.839229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1140/2276] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:07:27.851925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:27.862744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4cb9e-3f65-431a-815e-c51142af4019 service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:27.869216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:27.870402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:27.870698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:27.871030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:27.882032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:27.884142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:27.893873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1137/2277] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:07:28.142668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6b67-75a9-440c-8530-9fee2b06463d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:28.143529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6b67-75a9-440c-8530-9fee2b06463d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:28.143964 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6b67-75a9-440c-8530-9fee2b06463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:28.164148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cbba6b67-75a9-440c-8530-9fee2b06463d None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:28.165488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cbba6b67-75a9-440c-8530-9fee2b06463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:28.173463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1141/2278] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:28.186466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:28.200527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf271a2-8524-4eb4-8b8a-97b17396d3aa service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:28.206646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:28.207803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:28.208364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:28.209089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:28.234189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:28.236599 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:28.245531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1138/2279] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:07:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:07:28.581862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:28.582139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:28.582420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:28.602013 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:28.603306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:28.611410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1142/2280] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:28.623933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:28.634969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb5104-0b19-4260-a707-b5c9eedcaa05 service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:28.640057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:28.640677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:28.640962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:28.641284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:28.650430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:28.652067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08cf35-fb5e-4962-8e5d-a423018d82a3 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:28.661114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1139/2281] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:07:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 20:07:30.939398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:30.940864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:30.954940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6825-8194-440c-9ba3-562917bccf8e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:30.959558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:30.960199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:30.960482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:30.960757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] PATH_INFO: `/v3/users/74a49f3bba1f4925a1edc3ad9f7ab53e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:30.961935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a49f3bba1f4925a1edc3ad9f7ab53e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:30.963856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:31.009777 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a49f3bba1f4925a1edc3ad9f7ab53e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.016939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a49f3bba1f4925a1edc3ad9f7ab53e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.017579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a49f3bba1f4925a1edc3ad9f7ab53e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.029382 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a49f3bba1f4925a1edc3ad9f7ab53e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.030009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a49f3bba1f4925a1edc3ad9f7ab53e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.043260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1143/2282] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:07:30 2022] DELETE /identity/v3/users/74a49f3bba1f4925a1edc3ad9f7ab53e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:07:31.048350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:31.048816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:31.048922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:31.070821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:31.072040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:31.136416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1140/2283] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:07:31.147307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:31.149178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:31.206085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3533-8cec-46d0-abdc-417ed7985fd0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:31.209723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:31.210338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:31.210649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:31.210923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:31.220513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:31.221955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b292a-e141-4d6f-9b2d-b4b2cad00673 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:31.231323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1144/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:31.398612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:31.400056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:31.413460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb372bcd-ac2f-4c06-8c09-44187865b9d0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:31.419233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:31.419878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:31.420772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:31.420772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] PATH_INFO: `/v3/projects/a4b0dc5e930a4a19899927a2a376aba0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:31.421753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b0dc5e930a4a19899927a2a376aba0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:31.424510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:31.474885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b0dc5e930a4a19899927a2a376aba0', 'request_id': 'req-2e88547e-c345-43cb-8531-60edd36e00ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.483370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b0dc5e930a4a19899927a2a376aba0', 'request_id': 'req-2e88547e-c345-43cb-8531-60edd36e00ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.491050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b0dc5e930a4a19899927a2a376aba0', 'request_id': 'req-2e88547e-c345-43cb-8531-60edd36e00ac'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.503045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] The token cache is being invalidate because project a4b0dc5e930a4a19899927a2a376aba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:07:31.503339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.504025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2e88547e-c345-43cb-8531-60edd36e00ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:07:31.505865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1141/2285] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:07:31 2022] DELETE /identity/v3/projects/a4b0dc5e930a4a19899927a2a376aba0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:07:31.706717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01d22-f814-4b85-92d9-4486772d5425 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:31.707161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01d22-f814-4b85-92d9-4486772d5425 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:31.707563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01d22-f814-4b85-92d9-4486772d5425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:31.727884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e4e01d22-f814-4b85-92d9-4486772d5425 None None] MFA Rules not processed for user `38da90e025c84f7a8683c95fadd000e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:31.729084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e4e01d22-f814-4b85-92d9-4486772d5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:31.771636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:31.785207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1145/2286] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:07:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:41.499088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:41.781811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:48.585555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:48.586092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:48.586092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:48.605585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] MFA Rules not processed for user `7f7ce4ba826f4ed3911e14eae34f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:48.606819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:48.673355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1142/2287] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:07:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:48.986969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9e7-20ae-4c43-aa9d-75e6a421b065 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:48.987979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9e7-20ae-4c43-aa9d-75e6a421b065 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:48.988259 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9e7-20ae-4c43-aa9d-75e6a421b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:49.009214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ccdbb9e7-20ae-4c43-aa9d-75e6a421b065 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:49.011521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ccdbb9e7-20ae-4c43-aa9d-75e6a421b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:49.084172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1146/2288] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:49.107604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:49.109008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:49.183898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65271013-c3cc-4c53-9fa3-ff5ab01cce0d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:49.189575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:49.190227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:49.191186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:49.191460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:49.199921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:49.201523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:49.210889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1143/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:53.256845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7642-934b-42a9-8df8-ae38a55c6a94 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:53.257402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7642-934b-42a9-8df8-ae38a55c6a94 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:53.257402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b7642-934b-42a9-8df8-ae38a55c6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:53.277103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-333b7642-934b-42a9-8df8-ae38a55c6a94 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:53.278343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-333b7642-934b-42a9-8df8-ae38a55c6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:53.286975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1147/2290] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:53.308185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:53.319383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7f277-8350-474c-a43a-d9eeb4709b5e service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:53.324880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:53.325514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:53.325798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:53.326071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:53.334121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:53.335692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:53.345009 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1144/2291] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:07:58.489623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7275-2660-44e6-aa08-ba1f2ebad7ca None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:58.490163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7275-2660-44e6-aa08-ba1f2ebad7ca None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:58.490257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7275-2660-44e6-aa08-ba1f2ebad7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:58.509895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5b5a7275-2660-44e6-aa08-ba1f2ebad7ca None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:07:58.511095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b5a7275-2660-44e6-aa08-ba1f2ebad7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:07:58.519586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1148/2292] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:07:58.547900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:07:58.559412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4182d6-782a-4d29-b95c-5fbeea5fb2e8 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:07:58.565403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:07:58.566012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:07:58.566295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:07:58.566572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:07:58.574651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:07:58.576219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:07:58.586157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1145/2293] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:08:02.726024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff62d-6318-4abc-a29a-2959e73bd023 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:02.726634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff62d-6318-4abc-a29a-2959e73bd023 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:02.726634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbff62d-6318-4abc-a29a-2959e73bd023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:02.769816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7dbff62d-6318-4abc-a29a-2959e73bd023 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:08:02.769816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7dbff62d-6318-4abc-a29a-2959e73bd023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:02.782517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1149/2294] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:08:02.809626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:02.826142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4cfe-3118-4e5d-85ef-a525079c80ba service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:02.838441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:02.839626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:02.840130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:02.841091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:02.854072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:02.856060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b799607-62e1-4b8d-9d3d-d45f5c89c00b service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:02.868731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1146/2295] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:08:05.119391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:05.119905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:05.120000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:05.138574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] MFA Rules not processed for user `0d778a3f7d7e477dbcc4b06ba33ded03`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:08:05.139778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:05.194843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1150/2296] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:08:06.950402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b708e-128e-48aa-90ef-4252f1a577b2 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:06.951484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b708e-128e-48aa-90ef-4252f1a577b2 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:06.951970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b708e-128e-48aa-90ef-4252f1a577b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:06.998237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f17b708e-128e-48aa-90ef-4252f1a577b2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:08:06.999759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f17b708e-128e-48aa-90ef-4252f1a577b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:07.022088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1147/2297] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jul 28 20:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:08:07.047248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:07.064309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f923c-dc6e-4b64-849e-c4b4028b9172 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:07.074260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:07.074959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:07.075299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:07.075843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:07.086652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:07.088278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd234-041f-4733-abba-76b086af89f6 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:07.099310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1151/2298] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:08:12.824850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:12.825402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:12.825496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:12.833229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:12.847707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] MFA Rules not processed for user `dd02eac802ef4cfb81f8670124bc894f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:08:12.848910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:12.904140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1148/2299] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:08:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:08:17.094831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=67 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:22.898521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=24 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:26.282561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:26.283533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:26.283818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:26.307311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] MFA Rules not processed for user `4e9b85efb3e840b69ad3cf319855982f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:08:26.309125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:26.390912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1152/2300] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:08:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:08:36.382416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=25 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:41.396751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:41.398500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:41.415198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2cb5a-89e9-453a-8bdc-3423449d72ea None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:41.419715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:41.420354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:41.420645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:41.420939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] PATH_INFO: `/v3/users/38da90e025c84f7a8683c95fadd000e6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:41.422771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38da90e025c84f7a8683c95fadd000e6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:41.424838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:41.473807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38da90e025c84f7a8683c95fadd000e6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.480940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38da90e025c84f7a8683c95fadd000e6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.481643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38da90e025c84f7a8683c95fadd000e6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.482257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38da90e025c84f7a8683c95fadd000e6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.495706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38da90e025c84f7a8683c95fadd000e6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.510230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1149/2301] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:08:41 2022] DELETE /identity/v3/users/38da90e025c84f7a8683c95fadd000e6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:08:41.687102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:41.702478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0c43-7516-4107-955c-fe3898a28d98 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:41.760368 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:41.761016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:41.761320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:41.761603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] PATH_INFO: `/v3/projects/6b93a32ac3fe4af89e4bf4bdaed0c272` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:41.762759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b93a32ac3fe4af89e4bf4bdaed0c272)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:41.764667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:41.810598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b93a32ac3fe4af89e4bf4bdaed0c272', 'request_id': 'req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.818147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b93a32ac3fe4af89e4bf4bdaed0c272', 'request_id': 'req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.826163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b93a32ac3fe4af89e4bf4bdaed0c272', 'request_id': 'req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.837412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] The token cache is being invalidate because project 6b93a32ac3fe4af89e4bf4bdaed0c272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:08:41.837706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.838381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:08:41.839901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1153/2302] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:08:41 2022] DELETE /identity/v3/projects/6b93a32ac3fe4af89e4bf4bdaed0c272 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:08:47.919469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:47.920886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:47.978140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca41e-636a-409f-99e3-8caecbb71b8c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:48.025191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:48.025970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:48.026080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:48.026298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:48.028056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:48.069728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:48.098830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:48.100260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:48.113760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1150/2303] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:08:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:08:51.834412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:52.920902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:52.922411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:52.935343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a4e7-0b59-4e69-87bf-a3012ac85f98 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:52.939664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:52.940262 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:52.940543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:52.940818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:52.942526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:52.955561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:52.956973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:52.969223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1154/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:08:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:08:58.106263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=14 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:58.764813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:08:58.766252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:58.777594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4523cfd-49a1-44b4-b619-411a83107d2e service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:08:58.781476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:08:58.782093 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:08:58.782458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:08:58.782737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:08:58.784475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:08:58.847831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:08:58.849294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:08:58.858911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1151/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:01.998806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.000287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:02.015024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cb358-7622-487c-b051-e898b12fe507 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.020290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.021394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.021915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.022427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] PATH_INFO: `/v3/users/7f7ce4ba826f4ed3911e14eae34f3ea2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.024446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7ce4ba826f4ed3911e14eae34f3ea2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.026590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.088183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7ce4ba826f4ed3911e14eae34f3ea2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.096165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7ce4ba826f4ed3911e14eae34f3ea2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.096788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7ce4ba826f4ed3911e14eae34f3ea2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.110070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7ce4ba826f4ed3911e14eae34f3ea2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.111395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3b43bba3-bfb5-442c-b348-ad5e3e670bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7ce4ba826f4ed3911e14eae34f3ea2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.124133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1155/2306] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:01 2022] DELETE /identity/v3/users/7f7ce4ba826f4ed3911e14eae34f3ea2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:02.320301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.332039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7dee1-c6ff-4b1a-ad3d-a8f23b3c59fc service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.399538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.400194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.400478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.400772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] PATH_INFO: `/v3/projects/75c31252a1514821bbe33cae997cd7cc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.401952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c31252a1514821bbe33cae997cd7cc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.404186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.455768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c31252a1514821bbe33cae997cd7cc', 'request_id': 'req-b7016dfc-7ff1-43b0-8276-dde23a6dd394'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.467403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c31252a1514821bbe33cae997cd7cc', 'request_id': 'req-b7016dfc-7ff1-43b0-8276-dde23a6dd394'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.478401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c31252a1514821bbe33cae997cd7cc', 'request_id': 'req-b7016dfc-7ff1-43b0-8276-dde23a6dd394'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.491558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] The token cache is being invalidate because project 75c31252a1514821bbe33cae997cd7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:02.491920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.492555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b7016dfc-7ff1-43b0-8276-dde23a6dd394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:02.494170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1152/2307] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:02 2022] DELETE /identity/v3/projects/75c31252a1514821bbe33cae997cd7cc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:02.499099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.499398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.499683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.526272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:02.527782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:02.588904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1156/2308] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:02.596778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.597071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.597384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.617032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:02.618280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:02.626859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1153/2309] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:02.630900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.640869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4796-ca6e-46f2-82fb-4c9333190a29 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.645581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.646194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.646481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.646755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.647495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:02.647838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.649539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.661753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1157/2310] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:02.666177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.675997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e5d56-0d88-45d6-b576-43af5c4d03f8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.680724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.681370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.681658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.681935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.682596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.684534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.701718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:02.716773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1154/2311] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:02 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:02.721164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.731154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455e9dd-e889-4a8c-9574-dc2705b3650a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.775211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:02.789946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.790597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.790911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.791191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.791874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.793845 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.818330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1158/2312] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:02 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:02.820370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.831215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f1e9-25dd-4f41-a541-8b3235d61c86 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.835847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.836463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.836748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.837030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.837769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.839375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.849728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1155/2313] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:02.853670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.863858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4cdbb-e999-4545-b21b-ff085a952d90 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.868781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.869434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.869726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.870036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.870739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.872344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348d13b-2631-4a1c-a3ca-df7c1e77961f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.883753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1159/2314] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:02.888035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:02.899106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091b1d-1c04-47c8-acd4-62eef621de04 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:02.904222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:02.904939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.905229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.905575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] PATH_INFO: `/v3/projects/ac04c24b22ad47028b9900e2ac301715/users/13316b7e00d242e7bf9d40cb88ceedf1/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.920073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac04c24b22ad47028b9900e2ac301715, user_id=13316b7e00d242e7bf9d40cb88ceedf1, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:02.922769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:02.935982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1156/2315] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:02 2022] PUT /identity/v3/projects/ac04c24b22ad47028b9900e2ac301715/users/13316b7e00d242e7bf9d40cb88ceedf1/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:02.947297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:02.947586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:02.947866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:02.975169 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] MFA Rules not processed for user `13316b7e00d242e7bf9d40cb88ceedf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:02.976403 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:03.042042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1160/2316] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:03.054893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:03.056706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:03.132267 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572314-307d-4f2e-801b-b07dda240969 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:03.137815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:03.138439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:03.138721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:03.138995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:03.147051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:03.148671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:03.158324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1157/2317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:09:08.334990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:08.395616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5ed20-ca4f-4556-a5e9-fb21166a1af9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:08.400131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:08.400771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:08.401060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:08.401364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] PATH_INFO: `/v3/users/13316b7e00d242e7bf9d40cb88ceedf1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:08.402525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13316b7e00d242e7bf9d40cb88ceedf1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:08.404723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:08.450919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13316b7e00d242e7bf9d40cb88ceedf1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:08.458068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13316b7e00d242e7bf9d40cb88ceedf1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:08.458687 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13316b7e00d242e7bf9d40cb88ceedf1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:08.460577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:08.473520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13316b7e00d242e7bf9d40cb88ceedf1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:08.474105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-68e4da61-e3ae-42b4-acc5-8801252178d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13316b7e00d242e7bf9d40cb88ceedf1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:08.481411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:08.482931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:08.487347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1161/2318] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:08 2022] DELETE /identity/v3/users/13316b7e00d242e7bf9d40cb88ceedf1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:08.491726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:08.492018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:08.492449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:08.498379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b243-bda3-44e7-9872-621608cb60f4 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:08.511045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:08.512250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:08.564598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:08.565257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:08.565562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:08.565838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:08.567598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:08.572146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1162/2319] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:09:08.582650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:08.584021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:08.611569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:08.629399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:08.631031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:08.640108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1158/2320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:09:08.640950 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f316e02-1013-49c0-a210-22f592d2e885 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:08.645196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:08.645844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:08.646133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:08.646411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:08.657236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:08.658910 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1ca2-b7c1-4c89-8356-2915da30ce77 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:08.668765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1163/2321] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:09:08.947725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:08.949250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:08.963453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f014-b82a-4c49-9f09-c15fa259eb20 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:08.967920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:08.968570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:08.968836 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:08.969135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] PATH_INFO: `/v3/projects/ac04c24b22ad47028b9900e2ac301715` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:08.970401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac04c24b22ad47028b9900e2ac301715)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:08.972308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.019216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac04c24b22ad47028b9900e2ac301715', 'request_id': 'req-1fe23e63-ad44-4bfb-9f89-882fba8bf462'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:09.026255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac04c24b22ad47028b9900e2ac301715', 'request_id': 'req-1fe23e63-ad44-4bfb-9f89-882fba8bf462'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:09.032774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac04c24b22ad47028b9900e2ac301715', 'request_id': 'req-1fe23e63-ad44-4bfb-9f89-882fba8bf462'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:09.043342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] The token cache is being invalidate because project ac04c24b22ad47028b9900e2ac301715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:09.043645 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:09.044255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1fe23e63-ad44-4bfb-9f89-882fba8bf462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:09.045774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1159/2322] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:08 2022] DELETE /identity/v3/projects/ac04c24b22ad47028b9900e2ac301715 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:09.051022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.051312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.051594 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.070993 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:09.072190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:09.130720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1164/2323] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:09.138248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.138539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.138823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.159305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:09.160517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:09.168611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1160/2324] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:09.172866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.184659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417fd87-765c-496c-903e-5400942a4db0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.189942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.190547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.190828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.191102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.191790 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:09.192094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.193735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.205524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1165/2325] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:09.209878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.219039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dec4d-f83f-490d-92ef-e7f022810fee None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.223805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.224413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.224699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.224975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.225681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.227612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.255476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1161/2326] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:09.259599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.265991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:09.270703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af298362-71a4-4af2-bef2-9e9ee4347e41 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.327357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.327965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.328246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.329037 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.329721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.331638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.352310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1166/2327] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:09.356411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.366568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e19621-4b49-48f6-ac83-daf089eac450 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.371222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.371826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.372109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.372386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.373076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.374784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.384588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1162/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:09.388577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.399060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03371e-1922-4a7a-acea-3c43bb6cd086 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.403947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.404549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.404830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.405103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.405841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.407987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a85c-f757-46ec-8331-2d85aa0d41ba admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.419485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1167/2329] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:09.423496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.433294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902bb4-11ca-4acc-9b0c-ff519b2a433b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.438016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.438674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.438957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.439328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] PATH_INFO: `/v3/projects/be2ad3c9895b4169ba44905a66cc80c0/users/b68bcfae8b1649218c40ad4d810bfd02/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.455620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ad3c9895b4169ba44905a66cc80c0, user_id=b68bcfae8b1649218c40ad4d810bfd02, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.458343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.479437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1163/2330] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:09 2022] PUT /identity/v3/projects/be2ad3c9895b4169ba44905a66cc80c0/users/b68bcfae8b1649218c40ad4d810bfd02/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:09.490390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.490684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.490956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.518381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] MFA Rules not processed for user `b68bcfae8b1649218c40ad4d810bfd02`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:09.519596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:09.582504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1168/2331] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:09.586914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.646628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f938e-2a9f-4cad-9400-7270e4f91941 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.651259 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.651869 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.652144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.652419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.653250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.655530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.661573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:09.685335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1164/2332] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:09.689512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.699927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5659-c4fd-4c87-9f9b-7db4c0ed0dd9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.756347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.756962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.757248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.757564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.758239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.760127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.782935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1169/2333] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:09 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:09.790028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.801025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c51e60-161f-4860-8d36-01fe36d3ad00 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.805720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.806332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.806614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.806892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.807579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.809359 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.819951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1165/2334] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:09.823992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.829754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:09.837244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b90a-3a8b-4967-996c-87097b614624 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.842406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.843082 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.843397 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.843671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] PATH_INFO: `/v3/projects/1a530779c33047d2a6e1e9d2fc287163/users/3e2fa531ac1d4c008d2c42ad0c7b3c65/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.863979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a530779c33047d2a6e1e9d2fc287163, user_id=3e2fa531ac1d4c008d2c42ad0c7b3c65, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.866751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.883772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1170/2335] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:09 2022] PUT /identity/v3/projects/1a530779c33047d2a6e1e9d2fc287163/users/3e2fa531ac1d4c008d2c42ad0c7b3c65/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:09.885153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.895507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b685a-e9d6-417d-8946-2a3efa6ae047 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.954522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.955148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.955426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.955700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.956394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.958023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6116ad9-fb48-465a-ae2b-b2b2fe8522cb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:09.968887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1166/2336] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:09.973395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:09.983446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab07c-88ab-4d84-bff5-2c0fd446a3a8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:09.988652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:09.989476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:09.989624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:09.989899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] PATH_INFO: `/v3/projects/1a530779c33047d2a6e1e9d2fc287163/users/3e2fa531ac1d4c008d2c42ad0c7b3c65/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:09.991807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a530779c33047d2a6e1e9d2fc287163, user_id=3e2fa531ac1d4c008d2c42ad0c7b3c65, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:09.994476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:10.005009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1171/2337] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:09 2022] PUT /identity/v3/projects/1a530779c33047d2a6e1e9d2fc287163/users/3e2fa531ac1d4c008d2c42ad0c7b3c65/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:10.016925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:10.017214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:10.017522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:10.046077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] MFA Rules not processed for user `3e2fa531ac1d4c008d2c42ad0c7b3c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:10.047883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:10.124648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1167/2338] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:10.136512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:10.138242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:10.195205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed03b-6867-4805-bbf7-bb7f696af03a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:10.198862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:10.199473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:10.199757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:10.200036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:10.209532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:10.210954 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:10.221181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1172/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:10.304117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:10.313950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300e137-a827-4b85-a381-2b6f461577ee None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:10.317576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:10.318184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:10.318468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:10.318739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:10.372643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:10.378041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:10.381221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e177524-b892-4acb-827d-d150072307c0 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:10.390762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1168/2340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:15.113494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:15.175298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2dd8c-03a0-4d27-a546-61b0e5a7757b service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:15.179779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:15.180416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:15.180710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:15.180989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] PATH_INFO: `/v3/users/b68bcfae8b1649218c40ad4d810bfd02` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:15.182176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68bcfae8b1649218c40ad4d810bfd02)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:15.184101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:15.229449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68bcfae8b1649218c40ad4d810bfd02'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.237978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68bcfae8b1649218c40ad4d810bfd02'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.238683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68bcfae8b1649218c40ad4d810bfd02'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.251883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:15.253400 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68bcfae8b1649218c40ad4d810bfd02'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.254315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68bcfae8b1649218c40ad4d810bfd02'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.268702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1173/2341] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:15 2022] DELETE /identity/v3/users/b68bcfae8b1649218c40ad4d810bfd02 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:15.272974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:15.273462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:15.273600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:15.292493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:15.293735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:15.351672 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1169/2342] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:15.362029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:15.363442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:15.421155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32145-3d20-49d3-a83c-c62b71abacc0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:15.424846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:15.425551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:15.425783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:15.426065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:15.435066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:15.436521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:15.445941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1174/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:15.712332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:15.713973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:15.727254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ee0f-d82c-4768-b7c5-af6a3000f378 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:15.732575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:15.733223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:15.733536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:15.733811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] PATH_INFO: `/v3/projects/be2ad3c9895b4169ba44905a66cc80c0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:15.735786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2ad3c9895b4169ba44905a66cc80c0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:15.737814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:15.787844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2ad3c9895b4169ba44905a66cc80c0', 'request_id': 'req-dd561d62-b4e6-4224-be16-b24dd6e0c12e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.795826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2ad3c9895b4169ba44905a66cc80c0', 'request_id': 'req-dd561d62-b4e6-4224-be16-b24dd6e0c12e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.804643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2ad3c9895b4169ba44905a66cc80c0', 'request_id': 'req-dd561d62-b4e6-4224-be16-b24dd6e0c12e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.815752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] The token cache is being invalidate because project be2ad3c9895b4169ba44905a66cc80c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:15.816045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.816704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.818255 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1170/2344] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:15 2022] DELETE /identity/v3/projects/be2ad3c9895b4169ba44905a66cc80c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:15.822580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:15.832683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073c790-3a7a-4bb6-97e8-1a2006e7f5ca service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:15.898199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:15.898847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:15.899130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:15.899408 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] PATH_INFO: `/v3/users/3e2fa531ac1d4c008d2c42ad0c7b3c65` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:15.900566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2fa531ac1d4c008d2c42ad0c7b3c65)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:15.902525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:15.947616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2fa531ac1d4c008d2c42ad0c7b3c65'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.955312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2fa531ac1d4c008d2c42ad0c7b3c65'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.956036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2fa531ac1d4c008d2c42ad0c7b3c65'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.967839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2fa531ac1d4c008d2c42ad0c7b3c65'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.968465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-2d75e276-4186-4170-ad92-397f817044a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2fa531ac1d4c008d2c42ad0c7b3c65'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:15.980474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1175/2345] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:15 2022] DELETE /identity/v3/users/3e2fa531ac1d4c008d2c42ad0c7b3c65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:16.255483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.257239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:16.279551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561d62-b4e6-4224-be16-b24dd6e0c12e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.335628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.336270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.336548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.336819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] PATH_INFO: `/v3/projects/1a530779c33047d2a6e1e9d2fc287163` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.337967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a530779c33047d2a6e1e9d2fc287163)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.339878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.362537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:16.387064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a530779c33047d2a6e1e9d2fc287163', 'request_id': 'req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:16.394874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a530779c33047d2a6e1e9d2fc287163', 'request_id': 'req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:16.401059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a530779c33047d2a6e1e9d2fc287163', 'request_id': 'req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:16.411490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] The token cache is being invalidate because project 1a530779c33047d2a6e1e9d2fc287163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:16.411781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:16.412405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c760a4a9-1c5e-4e43-bd8e-e6dd704f2293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:16.413942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1171/2346] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:16 2022] DELETE /identity/v3/projects/1a530779c33047d2a6e1e9d2fc287163 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:16.418831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.419319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.419423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.439956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:16.441148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:16.445613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:16.502968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1176/2347] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:16.510626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.510914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.511193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.532234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:16.533461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:16.541441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1172/2348] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:16.545577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.555360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca71f7-1846-43f8-9b58-309a976c764f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.559947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.560555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.560839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.561118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.561847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:16.562178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.564294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.575699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1177/2349] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:16.580351 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.589564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaff97-5c20-4610-b468-75bfafa87302 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.594347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.594951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.595233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.595510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.596209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.598203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.624223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1173/2350] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:16.628752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.638771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6308-4a34-4f8c-baf6-681f1b82b17a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.694690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.695302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.695588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.695864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.696521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.698474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.719447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1178/2351] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:16.723508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.733619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4c42a-e817-4047-8d56-ad26c3edbe93 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.738727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.739334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.739616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.739889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.740582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.742201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.753232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1174/2352] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:16.757100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.767033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962d453-7aae-4d60-8aae-a1491e1da64c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.771885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.772522 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.772803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.773075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.773801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.775379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7a38-bfad-44b9-ac53-0b96515ab5d3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.786108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1179/2353] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:16.789975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:16.800479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110092-ef94-412f-b903-11e4ac082675 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:16.805152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:16.805857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.806139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.806416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] PATH_INFO: `/v3/projects/7f377f5ab3204bc0adbb4768259dbd8f/users/87dc6162966e4fa09cb0b7e272935b64/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.821488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f377f5ab3204bc0adbb4768259dbd8f, user_id=87dc6162966e4fa09cb0b7e272935b64, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:16.824143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:16.836962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1175/2354] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:16 2022] PUT /identity/v3/projects/7f377f5ab3204bc0adbb4768259dbd8f/users/87dc6162966e4fa09cb0b7e272935b64/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:16.847339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:16.847632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:16.847917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:16.875789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] MFA Rules not processed for user `87dc6162966e4fa09cb0b7e272935b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:16.877008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:16.942650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1180/2355] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:16.946831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.009808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd449-c878-4f89-a0ab-11d7cd2c3c50 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.014466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.015092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.015375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.015654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.016848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.018785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.051872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1176/2356] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:17.055709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.062982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:17.068819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f57f08-479e-4f03-827a-dd69ad70ea0d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.136922 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.137647 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.137932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.138206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.138884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.140797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.164688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1181/2357] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:17 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:17.168853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.179028 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3b1b-6823-440d-aafe-f1811f71a635 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.183585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.184187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.184464 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.184737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.185460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.187048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.197787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1177/2358] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:17.201751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.212352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedd095-9821-45b7-96d0-dd307152904f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.217035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.217779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.218089 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.218371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] PATH_INFO: `/v3/projects/c4391b6794c942e49d84689292e1513c/users/43e7dcd0953340a288440fcb19bf7f94/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.232915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4391b6794c942e49d84689292e1513c, user_id=43e7dcd0953340a288440fcb19bf7f94, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.235603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.249646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1182/2359] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:17 2022] PUT /identity/v3/projects/c4391b6794c942e49d84689292e1513c/users/43e7dcd0953340a288440fcb19bf7f94/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:17.254646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.264852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd549e5-0780-4d3b-bdb4-06e9c2b0e9f9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.281956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:17.322214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.322830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.323109 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.323381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.324145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.325774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763090-beed-4d7b-8f90-4d6336ba6a4e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.335810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1178/2360] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:09:17.339930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.351637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395931-d816-4ec7-8757-f95e15e75af2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.356315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.356984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.357286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.357577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] PATH_INFO: `/v3/projects/c4391b6794c942e49d84689292e1513c/users/43e7dcd0953340a288440fcb19bf7f94/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.359503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4391b6794c942e49d84689292e1513c, user_id=43e7dcd0953340a288440fcb19bf7f94, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.362189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.372200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1183/2361] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:17 2022] PUT /identity/v3/projects/c4391b6794c942e49d84689292e1513c/users/43e7dcd0953340a288440fcb19bf7f94/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:17.384081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.384367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.384641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.414380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] MFA Rules not processed for user `43e7dcd0953340a288440fcb19bf7f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:17.415612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:17.486675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1179/2362] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:17.497525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:17.499381 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:17.557889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384ca4-ea21-4dc8-bf1c-b6c3879f2ce7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:17.561573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:17.562196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:17.562480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:17.563334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:17.572424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:17.573897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c90308-f17e-4777-b673-eefabdff1602 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:17.583373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1184/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:18.123781 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:18.187451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aaae8-bdd1-4bbd-866c-3db0a05df0f0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:18.191927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:18.192569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:18.192852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:18.193127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] PATH_INFO: `/v3/users/87dc6162966e4fa09cb0b7e272935b64` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:18.194319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dc6162966e4fa09cb0b7e272935b64)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:18.196240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:18.242581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:18.246136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dc6162966e4fa09cb0b7e272935b64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.253516 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dc6162966e4fa09cb0b7e272935b64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.254201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dc6162966e4fa09cb0b7e272935b64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.254795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dc6162966e4fa09cb0b7e272935b64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.267102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dc6162966e4fa09cb0b7e272935b64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.279477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1180/2364] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:18 2022] DELETE /identity/v3/users/87dc6162966e4fa09cb0b7e272935b64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:18.284539 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:18.284830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:18.285113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:18.303557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:18.304763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:18.355820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:18.365141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1185/2365] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:18.374808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:18.376248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:18.433001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f57f3f-5096-49d5-a5af-ec45cf1e17a0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:18.436667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:18.437305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:18.437597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:18.437878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:18.446866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:18.448295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:18.458205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1181/2366] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:18.745569 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:18.747098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:18.760466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f689e-d445-44cc-982f-9f1828baddb8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:18.766692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:18.767443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:18.767900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:18.768160 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] PATH_INFO: `/v3/projects/7f377f5ab3204bc0adbb4768259dbd8f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:18.769524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f377f5ab3204bc0adbb4768259dbd8f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:18.771508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:18.833163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f377f5ab3204bc0adbb4768259dbd8f', 'request_id': 'req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.842661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f377f5ab3204bc0adbb4768259dbd8f', 'request_id': 'req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.849535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f377f5ab3204bc0adbb4768259dbd8f', 'request_id': 'req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.862530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] The token cache is being invalidate because project 7f377f5ab3204bc0adbb4768259dbd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:18.862828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.863532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.865024 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1186/2367] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:18 2022] DELETE /identity/v3/projects/7f377f5ab3204bc0adbb4768259dbd8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:18.869370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:18.880435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67989-f172-4d23-8267-fe826bc370d2 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:18.938983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:18.939638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:18.939925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:18.940202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] PATH_INFO: `/v3/users/43e7dcd0953340a288440fcb19bf7f94` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:18.941404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e7dcd0953340a288440fcb19bf7f94)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:18.943354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:18.991417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e7dcd0953340a288440fcb19bf7f94'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.998183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e7dcd0953340a288440fcb19bf7f94'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.998838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e7dcd0953340a288440fcb19bf7f94'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:18.999446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e7dcd0953340a288440fcb19bf7f94'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.006912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:19.013217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-4162d844-b674-45df-9cda-ec4c972f2b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e7dcd0953340a288440fcb19bf7f94'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.027846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1182/2368] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:18 2022] DELETE /identity/v3/users/43e7dcd0953340a288440fcb19bf7f94 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:19.309099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.310588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:19.330406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4452-4337-4a7b-a1e6-a129bbcc440e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.399268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.399839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.400128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.400412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] PATH_INFO: `/v3/projects/c4391b6794c942e49d84689292e1513c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.401632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4391b6794c942e49d84689292e1513c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.403842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.451756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4391b6794c942e49d84689292e1513c', 'request_id': 'req-c491228b-5b3f-45d7-966c-9b8568b93d32'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.459517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4391b6794c942e49d84689292e1513c', 'request_id': 'req-c491228b-5b3f-45d7-966c-9b8568b93d32'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.465328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4391b6794c942e49d84689292e1513c', 'request_id': 'req-c491228b-5b3f-45d7-966c-9b8568b93d32'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.480349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] The token cache is being invalidate because project c4391b6794c942e49d84689292e1513c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:19.480665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.481364 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c491228b-5b3f-45d7-966c-9b8568b93d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:19.482886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1187/2369] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:19 2022] DELETE /identity/v3/projects/c4391b6794c942e49d84689292e1513c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:19.488415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.488886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.488981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.511364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:19.512598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:19.576608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1183/2370] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:19.584361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.584674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.584952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.605092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:19.606330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:19.615158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1188/2371] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:19.619253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.628807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d6041-0c14-465c-a310-c48c91ee214d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.633367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.633977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.634260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.634540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.635238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:19.635545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.637151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.648633 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1184/2372] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:19.652744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.663190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c69e37-cbcb-414f-858e-c050d7ff56b7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.667880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.668483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.668765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.669043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.669755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.671674 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.676752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:19.700275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1189/2373] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:19 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:19.704834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.714740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1326ca5-ec4c-4ca3-be93-7e44ff61102b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.769960 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.770579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.770860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.771136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.771833 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.773836 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.794826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1185/2374] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:19 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:19.798927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.809258 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59019-b9ca-4ad2-8003-8a0f6b6aca78 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.814027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.814817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.815112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.815390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.816083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.817718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.827712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1190/2375] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:19.832072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.841920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbbfdf-5424-4d97-b417-36f7cc3e10c4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.847901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.848512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.848798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.849076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.850539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.852184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f823ca-bb43-41a6-9fc8-1c30d1d9205a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.862867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1186/2376] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:09:19.866982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:19.878597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cdf54-3fc8-4e61-b80f-42569001b409 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:19.887997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:19.888689 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.888976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.889257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] PATH_INFO: `/v3/projects/f3082c7213f14feaa9bbfc8269ffa6c1/users/5b3a9a12c8af4866ba4be5d77ada5978/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.905745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3082c7213f14feaa9bbfc8269ffa6c1, user_id=5b3a9a12c8af4866ba4be5d77ada5978, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:19.908999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:19.921907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1191/2377] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:19 2022] PUT /identity/v3/projects/f3082c7213f14feaa9bbfc8269ffa6c1/users/5b3a9a12c8af4866ba4be5d77ada5978/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:19.933142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:19.933536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:19.933824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:19.962195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] MFA Rules not processed for user `5b3a9a12c8af4866ba4be5d77ada5978`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:19.963409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:20.002045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:20.033149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1187/2378] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:20.037708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.102781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00a3a7-251d-4d2f-a744-5526da8f564c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.107512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.108188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.108410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.108694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.109407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.111317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.139360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1192/2379] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:20 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:20.144705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.156830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd875e-1d3d-4f21-af87-6a62f1a6f50d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.227532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.228264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.228725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.229073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.229890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.231879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.255536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1188/2380] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:20 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:20.259377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.270345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce651-9f93-4abc-a924-2fda38c50d30 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.275188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.275746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.276029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.276302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.277035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.278913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.289653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1193/2381] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:20.294082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.303993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a1a71-d0d1-4f72-9054-fbe17beb03a4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.308642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.309342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.309631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.309910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] PATH_INFO: `/v3/projects/52506e1db4ed4bc593cc39ac43e50c16/users/f3bffd46b8494b95bf7c672b3d2cd439/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.325301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52506e1db4ed4bc593cc39ac43e50c16, user_id=f3bffd46b8494b95bf7c672b3d2cd439, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.327993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.342584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1189/2382] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:20 2022] PUT /identity/v3/projects/52506e1db4ed4bc593cc39ac43e50c16/users/f3bffd46b8494b95bf7c672b3d2cd439/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:20.346660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.357477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e060-5e2a-40eb-84c3-badcceccc629 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.414625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.415165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.415450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.415728 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.416427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.418074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b778-b290-43fd-acf9-483e180b7e76 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.428374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1194/2383] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:20.433304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.445384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb7da-7746-405e-8c77-1d02714db564 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.450616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.451419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.451721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.451986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] PATH_INFO: `/v3/projects/52506e1db4ed4bc593cc39ac43e50c16/users/f3bffd46b8494b95bf7c672b3d2cd439/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.454745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52506e1db4ed4bc593cc39ac43e50c16, user_id=f3bffd46b8494b95bf7c672b3d2cd439, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.457702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.475821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1190/2384] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:20 2022] PUT /identity/v3/projects/52506e1db4ed4bc593cc39ac43e50c16/users/f3bffd46b8494b95bf7c672b3d2cd439/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:20.479010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.479413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.479705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.509618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] MFA Rules not processed for user `f3bffd46b8494b95bf7c672b3d2cd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:20.510858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:20.519576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:20.595063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1195/2385] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:20.605594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:20.607363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:20.666183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed706-5236-4332-80e2-4bcdc560e858 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:20.669675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:20.670284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:20.670572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:20.670845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:20.714325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:20.728493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:20.729974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:20.738685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1191/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:21.830203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:21.831614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:21.909134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b797f-e755-426b-b400-3cf0399f0837 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:21.914587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:21.915204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:21.915486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:21.915760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:21.917577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:21.975071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:21.976661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63c1b8-c242-44a4-aa18-01d59b7d8837 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:21.986043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1196/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:25.029532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:25.030934 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:25.042012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489054-7955-43b5-aaf6-3d6d814a4235 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:25.045612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:25.046221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:25.046511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:25.046789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:25.056139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:25.057654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:25.067591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1192/2388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:29.457827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:29.458425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:29.458425 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:29.479555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:29.481156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:29.531168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:29.550731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1197/2389] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:09:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:29.626881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:29.628392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:29.717553 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874be9-58f1-407e-9b86-ccacfd797972 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:29.723913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:29.724642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:29.724925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:29.725205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:29.734796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:29.736366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8aebf-9898-44a3-9085-96a39d65ed84 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:29.745223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1193/2390] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:09:30.192181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:30.275284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d855-193e-4ece-95d4-7cbac2f7c8fb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:30.281001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:30.282428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:30.282729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:30.283126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] PATH_INFO: `/v3/users/5b3a9a12c8af4866ba4be5d77ada5978` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:30.285929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3a9a12c8af4866ba4be5d77ada5978)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:30.288177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:30.368474 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3a9a12c8af4866ba4be5d77ada5978'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:30.385828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3a9a12c8af4866ba4be5d77ada5978'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:30.387399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3a9a12c8af4866ba4be5d77ada5978'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:30.408443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3a9a12c8af4866ba4be5d77ada5978'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:30.409532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3a9a12c8af4866ba4be5d77ada5978'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:30.426036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1198/2391] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:30 2022] DELETE /identity/v3/users/5b3a9a12c8af4866ba4be5d77ada5978 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:30.430884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:30.431469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:30.431896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:30.459369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:30.476642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:30.576390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1194/2392] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:09:30.602366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:30.604437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:30.722107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760657b2-0e17-47ab-92f6-76e0b5f1bee4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:30.739738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:30.740762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:30.741126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:30.741502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:30.754022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:30.756462 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:30.772118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1199/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:31.195418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:31.197522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:31.227249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0072f-194f-459d-82bf-748c4d4fdba8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:31.242392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:31.243978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:31.244444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:31.244889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] PATH_INFO: `/v3/projects/f3082c7213f14feaa9bbfc8269ffa6c1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:31.246466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3082c7213f14feaa9bbfc8269ffa6c1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:31.249186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:31.371847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3082c7213f14feaa9bbfc8269ffa6c1', 'request_id': 'req-41faf78e-cf11-4db4-9899-9f1c3c5890bf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.393539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3082c7213f14feaa9bbfc8269ffa6c1', 'request_id': 'req-41faf78e-cf11-4db4-9899-9f1c3c5890bf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.395635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:31.404104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3082c7213f14feaa9bbfc8269ffa6c1', 'request_id': 'req-41faf78e-cf11-4db4-9899-9f1c3c5890bf'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.429074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] The token cache is being invalidate because project f3082c7213f14feaa9bbfc8269ffa6c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:31.429873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.430651 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-41faf78e-cf11-4db4-9899-9f1c3c5890bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.432560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1195/2394] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:31 2022] DELETE /identity/v3/projects/f3082c7213f14feaa9bbfc8269ffa6c1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:31.436669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:31.455211 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9843fd-eda7-4601-b593-928aaa37fecc service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:31.466714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:31.560072 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:31.561068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:31.561634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:31.562887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] PATH_INFO: `/v3/users/f3bffd46b8494b95bf7c672b3d2cd439` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:31.565934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bffd46b8494b95bf7c672b3d2cd439)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:31.568347 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:31.698775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bffd46b8494b95bf7c672b3d2cd439'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.726980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bffd46b8494b95bf7c672b3d2cd439'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.727912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bffd46b8494b95bf7c672b3d2cd439'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.759196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bffd46b8494b95bf7c672b3d2cd439'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.761097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bffd46b8494b95bf7c672b3d2cd439'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:31.801968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1200/2395] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:31 2022] DELETE /identity/v3/users/f3bffd46b8494b95bf7c672b3d2cd439 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:31.943002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:31.944016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:31.944411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:31.970230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] MFA Rules not processed for user `dd02eac802ef4cfb81f8670124bc894f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:31.972052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.113207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1196/2396] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:32.315909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:32.317606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.433070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc31206-764f-48d0-8f36-c8923069ce8a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:32.441427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:32.442331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.442624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.442906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] PATH_INFO: `/v3/projects/52506e1db4ed4bc593cc39ac43e50c16` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:32.444604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=52506e1db4ed4bc593cc39ac43e50c16)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:32.446708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:32.511593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:32.537981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:32.540311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.541148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52506e1db4ed4bc593cc39ac43e50c16', 'request_id': 'req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:32.554553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52506e1db4ed4bc593cc39ac43e50c16', 'request_id': 'req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:32.565119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52506e1db4ed4bc593cc39ac43e50c16', 'request_id': 'req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:32.583960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] The token cache is being invalidate because project 52506e1db4ed4bc593cc39ac43e50c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:32.587955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:32.591060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6d832333-d8f6-441b-bc53-36e9ad6cd3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:32.593477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1201/2397] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:32 2022] DELETE /identity/v3/projects/52506e1db4ed4bc593cc39ac43e50c16 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:32.599818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b9d7-69f1-4aa2-9fb3-b5c6cb066960 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.600114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b9d7-69f1-4aa2-9fb3-b5c6cb066960 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.600392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b9d7-69f1-4aa2-9fb3-b5c6cb066960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:32.647002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1012b9d7-69f1-4aa2-9fb3-b5c6cb066960 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:32.648959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1012b9d7-69f1-4aa2-9fb3-b5c6cb066960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.652121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e8d33-2cbb-4c7d-af4a-c26d8c37e5bf None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:32.754523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:32.755161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.755443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.755724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:32.759361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.774745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:32.776142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:32.781938 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1202/2398] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:09:32.806766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1197/2399] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:09:32.815465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.821323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.821621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:32.863599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:32.865696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:32.906345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1203/2400] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:32.911216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:32.934107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2635d0-9735-4bdf-8f2f-067722ad970c service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:32.944084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:32.944721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.945005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.945367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:32.946202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:32.946526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:32.948157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:32.969308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1198/2401] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:32.975809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:32.990063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ebb7f-5a12-4c99-9ce7-57e162f951f3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:32.998362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:32.998992 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:32.999279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:32.999556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.000795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.002746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.045457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1204/2402] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:32 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:33.051983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.083901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95066b6-0b37-4bfb-b5b5-37682e12f7e5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.144361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:33.225657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.226606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.228768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.229171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.230445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.232988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.275734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1199/2403] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:33 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:33.282006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.295008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948485-f14d-4c7c-9150-7c6f4633629d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.314246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.315309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.315309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.317726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.318467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.320110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.337736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.339499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:33.355905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1205/2404] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:33.360116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.379867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875e15-0538-43ee-82b4-9165e0988076 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.397706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.398892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.398892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.398892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.399692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.401479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.427789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1206/2405] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:09:33.430695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.452915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dcb41-641f-4088-a8d9-1af4ef857ba4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.462225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.463901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.464210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.464490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] PATH_INFO: `/v3/projects/c2f697af815d431e84f3ad4cae471ff1/users/73c16fcd5f2746c084ebec8e03c0ac50/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.500947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f697af815d431e84f3ad4cae471ff1, user_id=73c16fcd5f2746c084ebec8e03c0ac50, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.504046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9738ac8-ee5a-4ecf-87be-9d6af3fa2bcc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.522434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339e903-bc46-441e-9034-3647e4ab7404 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.550623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1207/2406] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:33 2022] PUT /identity/v3/projects/c2f697af815d431e84f3ad4cae471ff1/users/73c16fcd5f2746c084ebec8e03c0ac50/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:33.617312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.617312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.617312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.628350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.629174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.629514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.629850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.631901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:33.645616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] MFA Rules not processed for user `73c16fcd5f2746c084ebec8e03c0ac50`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:33.646619 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.647389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:33.648281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.665451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1200/2407] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:33.695587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:33.744614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1208/2408] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:33.757969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:33.760407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:33.893482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1908ab-4dfe-4194-b76d-e27c28cf0312 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:33.900277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:33.901575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:33.902583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:33.903843 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:33.919829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:33.925400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8a6cc-72ec-4dce-9369-b11662fa32bf service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:33.954262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:33.963483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1201/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:33.990927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:34.102273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51587-e243-4285-b4d6-3549a9130346 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:34.107556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:34.108085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:34.108375 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:34.108788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] PATH_INFO: `/v3/users/73c16fcd5f2746c084ebec8e03c0ac50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:34.110648 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c16fcd5f2746c084ebec8e03c0ac50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:34.112605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:34.184105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c16fcd5f2746c084ebec8e03c0ac50'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:34.196918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c16fcd5f2746c084ebec8e03c0ac50'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:34.197600 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c16fcd5f2746c084ebec8e03c0ac50'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:34.213876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c16fcd5f2746c084ebec8e03c0ac50'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:34.214889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c16fcd5f2746c084ebec8e03c0ac50'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:34.235280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1209/2410] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:33 2022] DELETE /identity/v3/users/73c16fcd5f2746c084ebec8e03c0ac50 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:34.239728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:34.240021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:34.240303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:34.263922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:34.265180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:34.339979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1202/2411] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:34.351265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:34.352815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:34.513164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf44e3-6ca7-467b-9bc1-e29d48908e6d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:34.531757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:34.532424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:34.532701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:34.532983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:34.541246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:34.559480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:34.561156 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eed38-6a28-4232-95ef-220f9d4074e5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:34.576068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1210/2412] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:35.132055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.133604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:35.154879 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb067b1-2721-4cb6-b8fe-72cdfcc34d08 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.179752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.180812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.180812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.181031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] PATH_INFO: `/v3/projects/c2f697af815d431e84f3ad4cae471ff1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.188152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f697af815d431e84f3ad4cae471ff1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.198217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.286188 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f697af815d431e84f3ad4cae471ff1', 'request_id': 'req-ec6d9370-60d9-46a8-8c4d-84edabe94187'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:35.299228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f697af815d431e84f3ad4cae471ff1', 'request_id': 'req-ec6d9370-60d9-46a8-8c4d-84edabe94187'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:35.313757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f697af815d431e84f3ad4cae471ff1', 'request_id': 'req-ec6d9370-60d9-46a8-8c4d-84edabe94187'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:35.330444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] The token cache is being invalidate because project c2f697af815d431e84f3ad4cae471ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:35.330764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:35.334236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ec6d9370-60d9-46a8-8c4d-84edabe94187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:35.338648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1203/2413] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:35 2022] DELETE /identity/v3/projects/c2f697af815d431e84f3ad4cae471ff1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:35.343778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.344275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.344360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.368724 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:35.369989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:35.442155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1211/2414] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:35.449372 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.449665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.449953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.473983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:35.475201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:35.484532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1204/2415] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:35.489768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.501105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675829-7a23-4e9c-87d9-41fd3ec7ed72 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.505939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.506664 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.507046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.507428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.510325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:35.510325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.510325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.525000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1212/2416] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:09:35.529688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.540647 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32826b-cb29-4e12-b4c4-8b2bd098d319 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.545541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.546261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.547208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.547576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.548346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.550466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.583799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1205/2417] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:35 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:35.590491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.601768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52be0c-daf3-4fb5-9352-0c823c1ba9e3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.669407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.670052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.670335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.670614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.671441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.674111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.702064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1213/2418] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:35 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:35.703348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.714650 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e67afc-5bf3-48f0-8aa5-f396c1ded446 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.720423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.727673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.729587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.730082 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.730973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.746808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.759226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1206/2419] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:35.763058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.775697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b5537-adcc-47b4-a52e-0231a807afb1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.781613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.782317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.782708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.783198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.783903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.785779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523681-d26b-4ac5-896c-dcf0c0793364 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.802342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1214/2420] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:35.803543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:35.814952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d833-2ca7-4c18-a25a-e2d0d55eeb4b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:35.819841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:35.820514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.820817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.821071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] PATH_INFO: `/v3/projects/f148efa43f984d0a9720b87b2c0f772d/users/1f3cf7b5200742139c147e68882f670e/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.839621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f148efa43f984d0a9720b87b2c0f772d, user_id=1f3cf7b5200742139c147e68882f670e, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:35.842317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:35.859504 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1207/2421] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:35 2022] PUT /identity/v3/projects/f148efa43f984d0a9720b87b2c0f772d/users/1f3cf7b5200742139c147e68882f670e/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:35.869968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:35.870257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:35.870538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:35.903630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] MFA Rules not processed for user `1f3cf7b5200742139c147e68882f670e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:35.904865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:35.989220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:36.014182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1215/2422] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:36.018900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.081878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:36.135751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2ff96-0b2f-4411-b385-87f99a2b859c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.141846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.142527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.142909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.143286 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.144065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.146192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.183744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1208/2423] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:36 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:36.184958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.200919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021fc1e-c7c0-4bf7-850a-cf4a875944ce None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.279717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.280913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.281369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.281702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.282544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.284726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.314984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1216/2424] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:36 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:36.316723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.327199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef6e03-ae35-4a6a-b97e-43dcb981fb73 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.333318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.333318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.333737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.334033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.334772 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.336419 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.348170 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1209/2425] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:36.352267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.363470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16291-2b96-4a6b-8758-c8c83dd77b03 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.368552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.371251 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.371621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.371979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] PATH_INFO: `/v3/projects/3f8cdefccfae4943a87f08580c9ddad4/users/59b76675e59d4220a28e191f09571e7d/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.389259 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8cdefccfae4943a87f08580c9ddad4, user_id=59b76675e59d4220a28e191f09571e7d, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.394434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.413906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1217/2426] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:36 2022] PUT /identity/v3/projects/3f8cdefccfae4943a87f08580c9ddad4/users/59b76675e59d4220a28e191f09571e7d/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:36.418248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.433932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54d8e-5e50-40e7-8655-7fa10861c69c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.518124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.519636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.520014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.520373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.521156 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.522883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109305c6-a70c-4222-be44-b2bf8288ebfb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.536605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1210/2427] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:36.540551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.552577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561191e5-bf52-4660-a75a-4a87b1f03f1f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.560521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.561434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.561823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.562246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] PATH_INFO: `/v3/projects/3f8cdefccfae4943a87f08580c9ddad4/users/59b76675e59d4220a28e191f09571e7d/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.564370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8cdefccfae4943a87f08580c9ddad4, user_id=59b76675e59d4220a28e191f09571e7d, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.567970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.589295 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1218/2428] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:36 2022] PUT /identity/v3/projects/3f8cdefccfae4943a87f08580c9ddad4/users/59b76675e59d4220a28e191f09571e7d/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:09:36.601336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.601730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.602220 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.634166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] MFA Rules not processed for user `59b76675e59d4220a28e191f09571e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:36.635556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:36.729083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1211/2429] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:36.740470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:36.742479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:36.823810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e99201-8571-4568-a420-4fd53ed8d357 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:36.829676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:36.830555 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:36.830947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:36.831311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:36.911955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:36.914281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:36.918317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:36.925870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1219/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:38.319051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:38.320798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:38.347236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:38.426586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4b92-8f5b-4aaf-9176-bc0591333207 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:38.463395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:38.464063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:38.464352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:38.464638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:38.473394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:38.496693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:38.498204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:38.534294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1212/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:38.930991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:38.935226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:39.127198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326e5af-a204-4e10-9221-05aa6b1331c2 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:39.134712 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:39.135587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:39.136021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:39.136477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:39.138807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:39.163146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:39.165518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:39.182661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1220/2432] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:39.820123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:39.928834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66196-6184-4ef9-8779-793950c59a1c service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:39.943726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:39.945484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:39.946886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:39.948620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] PATH_INFO: `/v3/users/1f3cf7b5200742139c147e68882f670e` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:39.950714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3cf7b5200742139c147e68882f670e)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:39.957532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:39.976207 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:39.978570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:40.006932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003afba-57ae-43b5-afe4-4a167bd0489b service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:40.030357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:40.032503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:40.033050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:40.033615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:40.037396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:40.082123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:40.084774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3cf7b5200742139c147e68882f670e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:40.092016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103b3b-be77-4fbd-81a7-3bbb38cc7461 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:40.113953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3cf7b5200742139c147e68882f670e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:40.115243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3cf7b5200742139c147e68882f670e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:40.115878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3cf7b5200742139c147e68882f670e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:40.126703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1221/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:40.131877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3cf7b5200742139c147e68882f670e'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:40.162074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1213/2434] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:39 2022] DELETE /identity/v3/users/1f3cf7b5200742139c147e68882f670e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:40.166416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:40.166706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:40.166985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:40.210337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:40.211591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:40.408042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1222/2435] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:40.440420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:40.443715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:40.520260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:40.566414 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8c770-45b7-465f-b459-3681e7d72abe admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:40.574321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:40.575269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:40.577334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:40.578440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:40.609485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:40.612037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:40.638214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1214/2436] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:41.415856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:41.417371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:41.444449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d015f2f-0257-41f9-a96d-b0772dc178f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:41.457020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:41.457727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:41.458021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:41.458306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] PATH_INFO: `/v3/projects/f148efa43f984d0a9720b87b2c0f772d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:41.462624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f148efa43f984d0a9720b87b2c0f772d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:41.464580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:41.575098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f148efa43f984d0a9720b87b2c0f772d', 'request_id': 'req-d68ea01c-441c-458a-bfcf-5ea05e4e1557'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.588269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f148efa43f984d0a9720b87b2c0f772d', 'request_id': 'req-d68ea01c-441c-458a-bfcf-5ea05e4e1557'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.598009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f148efa43f984d0a9720b87b2c0f772d', 'request_id': 'req-d68ea01c-441c-458a-bfcf-5ea05e4e1557'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.599947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:41.613982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] The token cache is being invalidate because project f148efa43f984d0a9720b87b2c0f772d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:41.614420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.615383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.620971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1223/2437] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:41 2022] DELETE /identity/v3/projects/f148efa43f984d0a9720b87b2c0f772d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:41.622074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:41.635360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437307-6716-4d61-955d-fb04ca22c836 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:41.753113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:41.753830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:41.754117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:41.754395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] PATH_INFO: `/v3/users/59b76675e59d4220a28e191f09571e7d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:41.755596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b76675e59d4220a28e191f09571e7d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:41.757565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:41.819597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b76675e59d4220a28e191f09571e7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.828649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b76675e59d4220a28e191f09571e7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.829566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b76675e59d4220a28e191f09571e7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.830277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b76675e59d4220a28e191f09571e7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.845305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-417bd247-4fca-47ec-bc13-3a09e77ce684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b76675e59d4220a28e191f09571e7d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:41.859456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1215/2438] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:41 2022] DELETE /identity/v3/users/59b76675e59d4220a28e191f09571e7d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:42.213843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:42.215524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:42.238764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea01c-441c-458a-bfcf-5ea05e4e1557 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:42.311355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:42.312325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.312610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.312900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] PATH_INFO: `/v3/projects/3f8cdefccfae4943a87f08580c9ddad4` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.314264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8cdefccfae4943a87f08580c9ddad4)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:42.317111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:42.386597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8cdefccfae4943a87f08580c9ddad4', 'request_id': 'req-0b3281c1-da70-435c-9281-a994825551b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:42.401110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8cdefccfae4943a87f08580c9ddad4', 'request_id': 'req-0b3281c1-da70-435c-9281-a994825551b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:42.408819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8cdefccfae4943a87f08580c9ddad4', 'request_id': 'req-0b3281c1-da70-435c-9281-a994825551b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:42.421846 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] The token cache is being invalidate because project 3f8cdefccfae4943a87f08580c9ddad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:42.422531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:42.422889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0b3281c1-da70-435c-9281-a994825551b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:42.424765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1224/2439] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:42 2022] DELETE /identity/v3/projects/3f8cdefccfae4943a87f08580c9ddad4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:42.430224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.430652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.431034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.452631 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:42.457197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:42.534248 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:42.554518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1216/2440] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:42.562273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.562660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.563178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.585176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:42.586545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:42.596198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1225/2441] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:42.600347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:42.611151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b394e-ee63-4e49-b34a-5c2a6e8d21c3 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:42.616295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:42.616924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.617242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.617593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.618298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:42.618615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:42.620258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:42.638285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1217/2442] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:09:42.639700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:42.650265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7cd7-a19a-4d90-8c92-ca4c07f6b81a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:42.675385 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:42.676285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.676771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.677219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.678190 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:42.680138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:42.744953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1226/2443] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:42 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:42.746189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:42.786758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe052b5-f36b-4b6d-a61a-16ddc7ddc5c4 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:42.908918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:42.909886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.910374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.910903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.911773 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:42.914180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:42.954353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1218/2444] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:42 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:42.955376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:42.966987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f69c2-fbeb-4856-b94a-dff1bf556f89 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:42.972289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:42.973004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:42.973469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:42.973758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:42.974488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:42.976162 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:42.988405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1227/2445] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:09:42.992566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:43.004076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99f39-911d-459c-b3be-7d9a4691f7e9 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:43.014323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:43.024171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:43.024171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:43.024171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:43.024171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:43.024171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91ad53-388b-4375-9d24-409629e283c9 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:43.031438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1219/2446] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:43.038042 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:43.063044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22c75-ad5b-46bb-bba1-30f1bc8bc8ef admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:43.072278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:43.073601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:43.074213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:43.074797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] PATH_INFO: `/v3/projects/c91771d1b77945669d443d9aa588ba13/users/73a8c06fadd0470eb942c2180356fdb1/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:43.103979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91771d1b77945669d443d9aa588ba13, user_id=73a8c06fadd0470eb942c2180356fdb1, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:43.109477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:43.136815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1228/2447] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:43 2022] PUT /identity/v3/projects/c91771d1b77945669d443d9aa588ba13/users/73a8c06fadd0470eb942c2180356fdb1/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:43.154264 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:43.155240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:43.155240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:43.193884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] MFA Rules not processed for user `73a8c06fadd0470eb942c2180356fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:43.195300 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:43.266667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1220/2448] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:43.279642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:43.282085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:43.306516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:43.345011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145d12-6f95-4c3b-9ef2-d43b5d340bc2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:43.348815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:43.349406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:43.349692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:43.349970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:43.359351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:43.360708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:43.369470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1229/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:45.275401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:45.276756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:45.293465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:45.295651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:45.350707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:45.367791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb586c6-9b1a-4f55-a4fa-eccc8c285cf1 service glance] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:45.373152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:45.373848 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:45.374133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:45.374418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:45.375804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201298a5-d0a1-4e06-9d2f-e1af02c4e1b6 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:45.376195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:45.385653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:45.386514 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:45.386864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:45.387208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:45.389457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:45.404926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:45.407607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf485bb-e53e-438d-903d-58d54b32cc81 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:45.420376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1221/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:45.478767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:45.480372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cfa99-51b5-47c0-b36e-eaa2f81d1a76 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:45.492189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1230/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:48.096906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8a39-cb3c-4841-9643-5cb336118343 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.097422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8a39-cb3c-4841-9643-5cb336118343 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.097699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8a39-cb3c-4841-9643-5cb336118343 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.099179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1222/2452] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:09:48.105809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bae75-56f7-4285-a516-cf4ee8ad72ac None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.107563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bae75-56f7-4285-a516-cf4ee8ad72ac None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.107874 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bae75-56f7-4285-a516-cf4ee8ad72ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.149189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e93bae75-56f7-4285-a516-cf4ee8ad72ac None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:48.150434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e93bae75-56f7-4285-a516-cf4ee8ad72ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:48.162280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1231/2453] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:09:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:48.178758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b8a39-cb3c-4841-9643-5cb336118343 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:48.190768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b8a39-cb3c-4841-9643-5cb336118343 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:48.194374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:48.194982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.195258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.195529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.208431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:48.209925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8262d-f3ad-4063-964c-00b0f51beabf service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:48.221950 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1223/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:48.310386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110c6-f957-448c-8bd5-da9f87adb0d2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.310605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110c6-f957-448c-8bd5-da9f87adb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.310876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8110c6-f957-448c-8bd5-da9f87adb0d2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.313253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1232/2455] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:09:48.318834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdad2f-933d-4205-8309-7567ab994fbd None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.319130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdad2f-933d-4205-8309-7567ab994fbd None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.319411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdad2f-933d-4205-8309-7567ab994fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.341757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-39fdad2f-933d-4205-8309-7567ab994fbd None None] MFA Rules not processed for user `ae9a68a43b80458caf2e622129508c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:48.343306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-39fdad2f-933d-4205-8309-7567ab994fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:48.383016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1224/2456] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:09:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:48.400137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8110c6-f957-448c-8bd5-da9f87adb0d2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:48.416702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8110c6-f957-448c-8bd5-da9f87adb0d2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:48.421524 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:48.422276 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.422645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.422990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.431880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:48.433390 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93213-dd34-4785-af25-1faa3cc2ff53 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:48.444093 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1233/2457] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:48.592060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf647-5a8d-448a-a02d-7c0b7270b494 None None] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.592598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf647-5a8d-448a-a02d-7c0b7270b494 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.593584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf647-5a8d-448a-a02d-7c0b7270b494 None None] PATH_INFO: `/` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.595283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1225/2458] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 20:09:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 20:09:48.602039 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.602418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.602683 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.635729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] MFA Rules not processed for user `be490d99a6d94f5ead55b8d35019ec9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:48.637359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:48.671448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1234/2459] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 20:09:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:48.682758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf647-5a8d-448a-a02d-7c0b7270b494 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:48.694187 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf647-5a8d-448a-a02d-7c0b7270b494 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:48.697835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:48.698424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:48.698822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:48.698976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:48.718439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:48.719987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:48.733927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1226/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:49.770352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:49.770352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:49.830727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:49.852833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20c094-f4e0-486c-8b20-4800c2b37e1f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:49.863733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:49.864508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:49.864830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:49.865139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:49.867281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:49.880541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:49.882240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:49.887295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:49.890997 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:49.902153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1235/2461] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:49.908106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200550-9ffb-4c7c-a405-267b1948d845 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:49.912987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:49.913851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:49.915234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:49.915513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] PATH_INFO: `/v3/users/4e9b85efb3e840b69ad3cf319855982f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:49.916765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9b85efb3e840b69ad3cf319855982f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:49.918708 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:49.989389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9b85efb3e840b69ad3cf319855982f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.004862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9b85efb3e840b69ad3cf319855982f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.005725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9b85efb3e840b69ad3cf319855982f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.006668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9b85efb3e840b69ad3cf319855982f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.020970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b8d96198-3416-4bdb-a88a-8f6570b96b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9b85efb3e840b69ad3cf319855982f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.043098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1227/2462] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:09:49 2022] DELETE /identity/v3/users/4e9b85efb3e840b69ad3cf319855982f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:50.414482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:50.429244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc9db-7bd7-46ca-ae36-bc83a503875d service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:50.511575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:50.512360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:50.512715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:50.513068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] PATH_INFO: `/v3/projects/46dfdd15a1284dbc938c22ed7cc2b3d3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:50.514456 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dfdd15a1284dbc938c22ed7cc2b3d3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:50.516602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:50.580374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dfdd15a1284dbc938c22ed7cc2b3d3', 'request_id': 'req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.589493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dfdd15a1284dbc938c22ed7cc2b3d3', 'request_id': 'req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.601045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dfdd15a1284dbc938c22ed7cc2b3d3', 'request_id': 'req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.627929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] The token cache is being invalidate because project 46dfdd15a1284dbc938c22ed7cc2b3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:09:50.628222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.628926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dc8799b1-7ca9-43da-a5e2-c46e338cdabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:09:50.634686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1236/2463] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:09:50 2022] DELETE /identity/v3/projects/46dfdd15a1284dbc938c22ed7cc2b3d3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:50.639701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:50.639991 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:50.640273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:50.667463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:50.668948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:50.752611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1228/2464] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:50.760431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:50.760727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:50.761110 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:50.787698 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:50.788996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:50.806354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:50.812021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1237/2465] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:50.818152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aa03f-6d97-4618-bf80-218273a2ac6d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:50.824714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:50.825831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:50.826379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:50.826659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:50.828165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:09:50.828497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:50.830213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:50.849013 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1229/2466] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:09:50.853448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:50.863652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e0f3-121a-44c0-ada5-e6149671250e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:50.871649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:50.872636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:50.873114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:50.873640 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:50.875139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:50.877321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36575599-1374-4d27-98ea-c02aa589565a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:50.932939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1238/2467] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:50.937165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:50.948090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec8081-b660-4371-975a-c64796031703 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:50.959591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:51.014091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.014619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.015159 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.029070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.030199 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.030702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.031196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.032124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.034196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.038241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:51.039931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:51.090752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1230/2468] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:50 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:09:51.095290 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.109512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:51.122918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff5e0-3b14-46a5-b782-b1c0379f3ef0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.142060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.142713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.143166 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.143609 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.144865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.147239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.162546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1231/2469] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:09:51.165323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1239/2470] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:09:51.170875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.181075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1da803-5851-44ff-aeeb-9cd0113f4678 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.184970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.185940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.186610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.187610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.187610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.187895 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.188407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:51.189468 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.212948 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1232/2471] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:51.214380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.228536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c40e-7f6d-42c2-9ed5-5823f2948d19 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.234550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.236675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.237126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.237595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] PATH_INFO: `/v3/projects/4906a022f4054ca685aed5047f59506a/users/181855f9a0f340029fc2a9bf6586d8a1/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.260882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4906a022f4054ca685aed5047f59506a, user_id=181855f9a0f340029fc2a9bf6586d8a1, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.263684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eae3a7-bb0f-42ca-9148-a26af8eea3b3 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.282335 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1233/2472] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:51 2022] PUT /identity/v3/projects/4906a022f4054ca685aed5047f59506a/users/181855f9a0f340029fc2a9bf6586d8a1/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:51.295475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.295853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.296219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.301302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d244a-f2ef-40e4-bb21-0b6b69951e80 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.339989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] MFA Rules not processed for user `181855f9a0f340029fc2a9bf6586d8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:51.341238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:51.382761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.383407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.383695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.383977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.455562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1234/2473] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:09:51.459925 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.469983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.473062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.482970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1240/2474] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:09:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 20:09:51.535628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:51.563030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82ec0-db2a-41c8-897b-07754b6489cb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.569868 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.571172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.571471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.572438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.576214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.576214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.616764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1235/2475] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:09:51 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:51.617224 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.634494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72e8f7-ba3c-4aed-b7eb-80f6e3f43579 service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.728049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:51.808180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.808828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.809088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.809421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.810186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.812929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.844338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.845833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1241/2476] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:09:51 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:09:51.871153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefd1f7-f630-4a16-aa24-5ba34730f72f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.884178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.884820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.887268 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.887473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.888301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.890122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:51.909384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1236/2477] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:51.914631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:51.931103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5e5b-ad11-4f8f-a4f5-791924fdbbf0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:51.947070 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:51.947943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:51.948255 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:51.948686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] PATH_INFO: `/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07/users/f05ab5c8f7934c3dada63d369441a206/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:51.985628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3551bf8e5fa64a3f9bdb47b1bbe70a07, user_id=f05ab5c8f7934c3dada63d369441a206, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:51.994815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:52.024409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1242/2478] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:51 2022] PUT /identity/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07/users/f05ab5c8f7934c3dada63d369441a206/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:52.028783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:52.044097 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4f5e-b294-40bf-bfde-4a47f0e978a0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:52.187896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:52.188719 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:52.189027 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:52.189442 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:52.190458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:52.192427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca82f4-2d96-4131-ba78-73b569df487b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:52.220434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1237/2479] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:09:52.223983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:52.241017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f7a12-198c-4fd7-b6be-38e085eb7e8e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:52.264232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:52.264980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:52.265319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:52.265643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] PATH_INFO: `/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07/users/f05ab5c8f7934c3dada63d369441a206/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:52.267721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3551bf8e5fa64a3f9bdb47b1bbe70a07, user_id=f05ab5c8f7934c3dada63d369441a206, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:52.271026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:52.314890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1243/2480] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:09:52 2022] PUT /identity/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07/users/f05ab5c8f7934c3dada63d369441a206/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:09:52.324135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:52.324476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:52.324745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:52.434806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] MFA Rules not processed for user `f05ab5c8f7934c3dada63d369441a206`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:09:52.440107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:52.609039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1238/2481] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:09:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:09:52.620441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:52.622619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:09:52.721947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41f5e-5825-43fc-98d6-e2d9841d79ff admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:52.726597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:52.727337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:52.727557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:52.727911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:52.757098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:52.758618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:52.770416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1244/2482] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:09:52.887245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:09:52.901050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb921019-636c-4b41-9e09-58d831cb829e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:09:52.908391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:09:52.909037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:09:52.909362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:09:52.909642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:09:52.948239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:52.976252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:09:52.978072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ff175-7f87-4953-8693-85535ceeb19e service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:09:52.988993 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1239/2483] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:09:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:02.765139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=58,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:02.984748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=12 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:05.548362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:05.549884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:05.621219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0855-8745-429a-a68d-45f378c219eb service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:05.631869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:05.632534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:05.632819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:05.633098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] PATH_INFO: `/v3/users/73a8c06fadd0470eb942c2180356fdb1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:05.634321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a8c06fadd0470eb942c2180356fdb1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:05.636229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:05.692241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a8c06fadd0470eb942c2180356fdb1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:05.706378 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a8c06fadd0470eb942c2180356fdb1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:05.707147 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a8c06fadd0470eb942c2180356fdb1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:05.728654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a8c06fadd0470eb942c2180356fdb1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:05.729878 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a8c06fadd0470eb942c2180356fdb1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:05.744459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1245/2484] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:05 2022] DELETE /identity/v3/users/73a8c06fadd0470eb942c2180356fdb1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:05.749043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:05.749582 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:05.749903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:05.771857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:05.773750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:05.851391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1240/2485] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:05.861191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:05.862972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:05.937051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34c690-629a-4050-a19a-fda24097a009 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:05.941166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:05.941818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:05.942102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:05.942379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:05.954153 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:05.955773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d71e81-5981-4beb-b624-56eda21dfbe7 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:05.966121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1246/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:06.250796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:06.252432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:06.264751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a2cc-9e38-4162-a45d-cb15d1260296 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:06.269382 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:06.270033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:06.270383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:06.270591 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] PATH_INFO: `/v3/projects/c91771d1b77945669d443d9aa588ba13` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:06.271764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91771d1b77945669d443d9aa588ba13)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:06.273735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:06.322975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91771d1b77945669d443d9aa588ba13', 'request_id': 'req-6b45da4d-befd-4479-8cdd-4a3f20790a59'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:06.330054 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91771d1b77945669d443d9aa588ba13', 'request_id': 'req-6b45da4d-befd-4479-8cdd-4a3f20790a59'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:06.337094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91771d1b77945669d443d9aa588ba13', 'request_id': 'req-6b45da4d-befd-4479-8cdd-4a3f20790a59'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:06.348319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] The token cache is being invalidate because project c91771d1b77945669d443d9aa588ba13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:06.348606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:06.349236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:06.351037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1241/2487] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:06 2022] DELETE /identity/v3/projects/c91771d1b77945669d443d9aa588ba13 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:06.668508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:06.668995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:06.669108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:06.687968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:06.689179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:06.706135 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:06.744913 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1247/2488] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:06.757183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:06.758601 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:06.826260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45da4d-befd-4479-8cdd-4a3f20790a59 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:06.831763 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:06.832380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:06.832661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:06.832938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:06.840876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:06.843292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706c862-358a-4bdf-ac33-d96cfe6b4db9 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:06.851524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1242/2489] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:10:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:10:16.738402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=15 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:16.848314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:22.601558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:22.602962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:22.667269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6007-1601-4942-9f14-a27817f109c6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:22.671695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:22.672326 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:22.672629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:22.672904 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] PATH_INFO: `/v3/users/181855f9a0f340029fc2a9bf6586d8a1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:22.674187 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181855f9a0f340029fc2a9bf6586d8a1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:22.676250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:22.724300 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181855f9a0f340029fc2a9bf6586d8a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:22.731435 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181855f9a0f340029fc2a9bf6586d8a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:22.732120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181855f9a0f340029fc2a9bf6586d8a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:22.743813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181855f9a0f340029fc2a9bf6586d8a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:22.744449 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181855f9a0f340029fc2a9bf6586d8a1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:22.756927 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1248/2490] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:22 2022] DELETE /identity/v3/users/181855f9a0f340029fc2a9bf6586d8a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:22.761428 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:22.761903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:22.761996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:22.781753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:22.782940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:22.840056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1243/2491] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:22.849796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:22.851209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:22.909030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd6cf-adeb-4493-bb80-0a92be2a3299 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:22.912709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:22.913352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:22.913639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:22.913914 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:22.924858 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:22.927172 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:22.938969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1249/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:23.205064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:23.206687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:23.218581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b0dd-0917-45fa-aabf-47733c750308 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:23.224059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:23.224715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:23.225001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:23.225297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] PATH_INFO: `/v3/projects/4906a022f4054ca685aed5047f59506a` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:23.226480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4906a022f4054ca685aed5047f59506a)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:23.228491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:23.274933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4906a022f4054ca685aed5047f59506a', 'request_id': 'req-5969161d-ca5d-483a-8641-3cb960e87f05'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.283176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4906a022f4054ca685aed5047f59506a', 'request_id': 'req-5969161d-ca5d-483a-8641-3cb960e87f05'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.289346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4906a022f4054ca685aed5047f59506a', 'request_id': 'req-5969161d-ca5d-483a-8641-3cb960e87f05'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.299730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] The token cache is being invalidate because project 4906a022f4054ca685aed5047f59506a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:23.300045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.300681 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.302217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1244/2493] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:23 2022] DELETE /identity/v3/projects/4906a022f4054ca685aed5047f59506a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:23.306315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:23.315901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae257119-19f2-4fa9-bbfb-943f5a0de38e service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:23.334329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:23.380384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:23.381086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:23.381420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:23.381699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] PATH_INFO: `/v3/users/f05ab5c8f7934c3dada63d369441a206` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:23.382901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05ab5c8f7934c3dada63d369441a206)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:23.384798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:23.431080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05ab5c8f7934c3dada63d369441a206'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.437837 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05ab5c8f7934c3dada63d369441a206'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.439119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05ab5c8f7934c3dada63d369441a206'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.450814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05ab5c8f7934c3dada63d369441a206'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.451480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-932015a6-8ed9-4556-9f89-77028988f5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05ab5c8f7934c3dada63d369441a206'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.464393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1250/2494] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:23 2022] DELETE /identity/v3/users/f05ab5c8f7934c3dada63d369441a206 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:23.732000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:23.733517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:23.746710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969161d-ca5d-483a-8641-3cb960e87f05 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:23.805987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:23.806725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:23.806899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:23.807177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] PATH_INFO: `/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:23.808321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3551bf8e5fa64a3f9bdb47b1bbe70a07)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:23.810273 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:23.839659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:23.856811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3551bf8e5fa64a3f9bdb47b1bbe70a07', 'request_id': 'req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.864979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3551bf8e5fa64a3f9bdb47b1bbe70a07', 'request_id': 'req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.873063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3551bf8e5fa64a3f9bdb47b1bbe70a07', 'request_id': 'req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.884050 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] The token cache is being invalidate because project 3551bf8e5fa64a3f9bdb47b1bbe70a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:23.884338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.884995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-9eb7227a-567b-4cd3-a9cb-aecc2c2dd5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:23.886715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1245/2495] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:23 2022] DELETE /identity/v3/projects/3551bf8e5fa64a3f9bdb47b1bbe70a07 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:23.891430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:23.891827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:23.891990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:23.911761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:23.912967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:23.973123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1251/2496] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:23.982411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:23.982718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:23.982980 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.004007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:24.005239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:24.014788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1246/2497] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:24.019097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.029161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c592e93-0bfc-4b61-ac99-5b26d933dbfb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.033841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.034460 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.034750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.035213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.036548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:24.037094 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.038855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.052623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1252/2498] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:24.056995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.067095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9626e3-7f4c-4d72-9cbf-d1cf9d8fc5b1 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.072136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.072738 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.073018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.073329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.073987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.076291 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.103841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1247/2499] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:24.108043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.118587 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ea24-7c6a-40a2-af05-0a6e788f7e5a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.144800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:24.177099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.177764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.178036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.178317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.178990 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.180911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.201055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1253/2500] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:24.205117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.215314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d255-19d5-403e-85b1-ba30f03da74a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.220424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.221035 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.221349 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.221628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.222323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.223964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.233706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1248/2501] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:24.238047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.247961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf1d8-7a5f-48ad-bc63-d27cd609b34b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.252631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.253244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.253559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.253872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.254615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.256343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73edd62-aa2d-4df5-8fac-7e5b4e7b76b8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.267183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1254/2502] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:24.271339 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.281603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fa81c-53d4-4769-a102-f7c53d86bbb2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.286804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.287466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.287755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.288033 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] PATH_INFO: `/v3/projects/01a343787d294703b8664133ded2872f/users/952bdc919c7b4dee854276e64776053c/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.303008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a343787d294703b8664133ded2872f, user_id=952bdc919c7b4dee854276e64776053c, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.305705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.318556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1249/2503] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:24 2022] PUT /identity/v3/projects/01a343787d294703b8664133ded2872f/users/952bdc919c7b4dee854276e64776053c/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:24.328750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.329083 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.329406 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.358374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] MFA Rules not processed for user `952bdc919c7b4dee854276e64776053c`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:24.359582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:24.423730 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1255/2504] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:24.428281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.489287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591aa7e-faf6-4351-8e45-96dbd0da83c8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.493959 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.494576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.494860 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.495140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.495811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.497822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.528032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1250/2505] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:24.529132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.540432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562db2-d223-4ff0-bfdd-432d8215b6ee None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.599896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.600515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.600807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.601088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.601798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.603737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.623506 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1256/2506] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:24.627779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.638183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e9ff-eedb-4603-b2fb-c0358ec06152 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.643343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.643977 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.644263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.644543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.645281 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.646908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.658180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1251/2507] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:24.662313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.672387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea896a8-bc52-46ac-9d48-a0bcee83c10e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.677068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.677770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.678060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.678341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] PATH_INFO: `/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f/users/3132b465f04c4e3a90e10b205e4382ed/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.692760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e83a38ee2d4417a4d79ced4843e64f, user_id=3132b465f04c4e3a90e10b205e4382ed, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.695484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.709873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1257/2508] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:24 2022] PUT /identity/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f/users/3132b465f04c4e3a90e10b205e4382ed/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:24.714001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.724425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe671fd-f2be-40bb-a4f6-5b394ac54cf0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.743608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:24.782856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.783480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.783761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.784037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.784727 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.786367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868729d3-591a-4f9b-b1ac-253401839898 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.795969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1252/2509] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:24.800122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.805544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:24.811690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b5d7-c350-4bbe-a206-04eecb85dec0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:24.816925 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:24.817629 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.817933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.818210 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] PATH_INFO: `/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f/users/3132b465f04c4e3a90e10b205e4382ed/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.820167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e83a38ee2d4417a4d79ced4843e64f, user_id=3132b465f04c4e3a90e10b205e4382ed, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:24.822834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:24.833294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1258/2510] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:24 2022] PUT /identity/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f/users/3132b465f04c4e3a90e10b205e4382ed/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:24.843328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:24.843813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:24.843945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:24.872589 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] MFA Rules not processed for user `3132b465f04c4e3a90e10b205e4382ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:24.873761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:24.941210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1253/2511] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:24 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:24.952362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:24.954723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:25.009996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37787e-9543-459e-a6ea-14bac7f5ff70 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:25.013591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:25.014197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:25.014476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:25.014751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:25.024200 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:25.025645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:25.035154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1259/2512] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:24 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:25.107882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:25.117518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2573966-3987-4062-87e5-bac9ad241865 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:25.121219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:25.121862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:25.122147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:25.122424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:25.181421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:25.182827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:25.192216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1254/2513] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:25 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:28.734180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:28.736275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:28.808899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90504-49eb-461b-b3b0-6312966abc5e service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:28.814967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:28.815582 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:28.815867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:28.816142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:28.817871 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:28.874708 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:28.876921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557e2d0-9711-454d-98e9-407df81b63e9 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:28.887599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1260/2514] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:35.188369 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=80 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:38.882363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:40.137000 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:40.204228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1c9c-8ad5-4a07-8af1-129243c84d5c service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:40.209674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:40.210321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:40.210602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:40.210878 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] PATH_INFO: `/v3/users/952bdc919c7b4dee854276e64776053c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:40.212070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952bdc919c7b4dee854276e64776053c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:40.214085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:40.385153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952bdc919c7b4dee854276e64776053c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.392834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952bdc919c7b4dee854276e64776053c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.393546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952bdc919c7b4dee854276e64776053c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.394168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952bdc919c7b4dee854276e64776053c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.407443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952bdc919c7b4dee854276e64776053c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.423722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1255/2515] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:40 2022] DELETE /identity/v3/users/952bdc919c7b4dee854276e64776053c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:40.428208 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:40.428682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:40.428775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:40.447440 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:40.448626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:40.505139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1261/2516] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:40.514972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:40.516842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:40.572835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b29ecb-a0ab-4dc2-80ef-60f7c9f28705 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:40.576483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:40.577100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:40.577417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:40.577696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:40.587103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:40.588535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:40.598249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1256/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:40.857711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:40.859543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:40.872218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760f443-be1a-4434-8429-ea634b6e1ecd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:40.877567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:40.878213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:40.878496 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:40.878775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] PATH_INFO: `/v3/projects/01a343787d294703b8664133ded2872f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:40.879942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a343787d294703b8664133ded2872f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:40.881892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:40.932520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a343787d294703b8664133ded2872f', 'request_id': 'req-54bddbe5-2ec6-4f0e-adfc-3715480f3331'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.940088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a343787d294703b8664133ded2872f', 'request_id': 'req-54bddbe5-2ec6-4f0e-adfc-3715480f3331'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.946355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a343787d294703b8664133ded2872f', 'request_id': 'req-54bddbe5-2ec6-4f0e-adfc-3715480f3331'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.958073 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] The token cache is being invalidate because project 01a343787d294703b8664133ded2872f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:40.958373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.959025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:40.960821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1262/2518] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:40 2022] DELETE /identity/v3/projects/01a343787d294703b8664133ded2872f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:40.964475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:40.974537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628dd2-c502-40d9-ab38-d19c0695b5a3 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:40.994242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:41.038463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:41.039115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.039398 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.039677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] PATH_INFO: `/v3/users/3132b465f04c4e3a90e10b205e4382ed` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.041392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3132b465f04c4e3a90e10b205e4382ed)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:41.043444 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:41.092892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3132b465f04c4e3a90e10b205e4382ed'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.101481 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3132b465f04c4e3a90e10b205e4382ed'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.102306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3132b465f04c4e3a90e10b205e4382ed'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.103042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3132b465f04c4e3a90e10b205e4382ed'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.118128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3132b465f04c4e3a90e10b205e4382ed'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.136834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1257/2519] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:40 2022] DELETE /identity/v3/users/3132b465f04c4e3a90e10b205e4382ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:41.231911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:41.233547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:41.349249 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bddbe5-2ec6-4f0e-adfc-3715480f3331 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:41.401476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:41.416402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:41.417157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.417808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.417808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.419737 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:41.564137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:41.565944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:41.643854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:41.645089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c680f40-728a-493c-8750-e7778e6c8d4a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:41.645523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c438-f422-4006-9647-d8e87dc112e0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:41.649710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:41.650346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.650626 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.650901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] PATH_INFO: `/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.652316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e83a38ee2d4417a4d79ced4843e64f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:41.654250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:41.656330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1263/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:41.700873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:41.707402 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e83a38ee2d4417a4d79ced4843e64f', 'request_id': 'req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.716363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e83a38ee2d4417a4d79ced4843e64f', 'request_id': 'req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.723596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e83a38ee2d4417a4d79ced4843e64f', 'request_id': 'req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.734417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] The token cache is being invalidate because project a1e83a38ee2d4417a4d79ced4843e64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:41.734706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.735350 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-8cbe6888-16ae-4fb6-82c6-7b4a36bfc80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:41.737060 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1258/2521] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:41 2022] DELETE /identity/v3/projects/a1e83a38ee2d4417a4d79ced4843e64f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:41.741855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.742148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.742426 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.762591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:41.763870 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:41.824396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1264/2522] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:41.832440 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.832722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.832996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.852978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:41.854298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:41.865639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1259/2523] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:41.870100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:41.880865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea2c3-25c7-4278-b84c-a9d75d644b75 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:41.889971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:41.890618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.890900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.891177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.891881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:41.892192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:41.893882 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:41.907293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1265/2524] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:41.911848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:41.921183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305780-982d-4143-849a-4fbcd7a75fa8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:41.927132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:41.927737 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:41.928125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:41.928358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:41.929055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:41.930995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:41.961893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1260/2525] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:41 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:41.963405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:41.973994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f6f3-07f4-4196-902c-38265be43816 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.032653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.033288 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.033601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.033881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.034549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.036467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.058242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1266/2526] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:41 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:42.063196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.073896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e975a1-fb2b-4fd1-a389-f96dcfbe5985 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.079223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.079906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.080194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.080473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.081172 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.082820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.093229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1261/2527] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:42.100133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.110977 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a2ea8-c73e-4994-8871-726c70c1e5c4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.115700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.116388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.116699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.116982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.117707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.119308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e512-0800-45e6-a26c-2fccf1eb54be admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.120747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:42.131466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1267/2528] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:42.135807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.146760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2163c-6487-455d-8156-687abd3aa424 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.151462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.152409 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.152693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.154215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] PATH_INFO: `/v3/projects/2d8da89c07524ce4831a7adf98a0a824/users/9b0c7a8130b34c6796616bdf2eaf1c64/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.168008 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8da89c07524ce4831a7adf98a0a824, user_id=9b0c7a8130b34c6796616bdf2eaf1c64, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.170697 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.185189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1262/2529] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:42 2022] PUT /identity/v3/projects/2d8da89c07524ce4831a7adf98a0a824/users/9b0c7a8130b34c6796616bdf2eaf1c64/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:42.196132 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.196424 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.196705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.228181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] MFA Rules not processed for user `9b0c7a8130b34c6796616bdf2eaf1c64`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:42.229499 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:42.293323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1268/2530] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:42.297910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.361547 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470136-936a-4de4-ba73-878dc59a6b27 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.366243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.366862 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.367146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.367424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.368088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.370067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.403901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1263/2531] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:42 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:42.405125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.416451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea03a3-98b4-48ab-b71a-13ad57061ed5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.478633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.479176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.479488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.479768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.480464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.482468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.507466 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1269/2532] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:42 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:42.512018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.523721 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27eac-cbe0-4721-b5a9-a0f84e48241f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.528709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.529373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.529660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.529939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.530825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.532593 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.543685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1264/2533] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:42.548532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.559279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1104a-46d0-4d8e-bc09-c9c50e73ba4f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.564769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.565494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.565781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.566203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] PATH_INFO: `/v3/projects/b48c687e211e4886997a0743a80e303d/users/32b11b3ccf8f434ab049e094b4e1e76f/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.582543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48c687e211e4886997a0743a80e303d, user_id=32b11b3ccf8f434ab049e094b4e1e76f, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.585231 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.600218 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1270/2534] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:42 2022] PUT /identity/v3/projects/b48c687e211e4886997a0743a80e303d/users/32b11b3ccf8f434ab049e094b4e1e76f/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:42.603987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.615393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6fc3-95f3-4bac-b0a6-cb7244a33a3f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.664887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:42.684485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.685116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.685505 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.685889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.686592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.688964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c8be-adf3-4dce-a0b9-fd367fabf1b4 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.699580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1265/2535] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:42.703612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.713742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a65c-5974-4e10-bb80-6feb4025b388 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.718330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.719028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.719306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.719581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] PATH_INFO: `/v3/projects/b48c687e211e4886997a0743a80e303d/users/32b11b3ccf8f434ab049e094b4e1e76f/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.721679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48c687e211e4886997a0743a80e303d, user_id=32b11b3ccf8f434ab049e094b4e1e76f, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.724299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.735343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1271/2536] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:42 2022] PUT /identity/v3/projects/b48c687e211e4886997a0743a80e303d/users/32b11b3ccf8f434ab049e094b4e1e76f/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:42.746333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.746629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.746969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.777375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] MFA Rules not processed for user `32b11b3ccf8f434ab049e094b4e1e76f`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:42.778637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:42.849277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1266/2537] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:42.860834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:42.862705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:42.922574 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:42.939649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcbed-c95c-47cc-aa70-47ec0dd95975 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:42.943491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:42.944182 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:42.944535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:42.944812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:42.954330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:42.955755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ea46-ee34-4c00-9c0a-148f59d85493 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:42.965792 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1272/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:44.624518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:44.715241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78154-cbc2-4e5f-840f-0699ee5babd8 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:44.724817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:44.725726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:44.726164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:44.726545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] PATH_INFO: `/v3/users/9b0c7a8130b34c6796616bdf2eaf1c64` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:44.728949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0c7a8130b34c6796616bdf2eaf1c64)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:44.731104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:44.816776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0c7a8130b34c6796616bdf2eaf1c64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:44.828523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0c7a8130b34c6796616bdf2eaf1c64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:44.829614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0c7a8130b34c6796616bdf2eaf1c64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:44.830533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0c7a8130b34c6796616bdf2eaf1c64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:44.841145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:44.851038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0c7a8130b34c6796616bdf2eaf1c64'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:44.869104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1267/2539] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:44 2022] DELETE /identity/v3/users/9b0c7a8130b34c6796616bdf2eaf1c64 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:44.873915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:44.874418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:44.874688 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:44.898319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:44.899607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:44.970057 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1273/2540] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:44.981787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:44.982949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:45.047829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d031b-229e-47d0-a540-730108643bee admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:45.052152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:45.052880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:45.053803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:45.054226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:45.066545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:45.068036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:45.079458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1268/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:45.611229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:45.616591 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:45.654896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf0566-3eeb-4c21-9bcc-d575ff57d89d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:45.676578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:45.677298 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:45.677610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:45.677888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] PATH_INFO: `/v3/projects/2d8da89c07524ce4831a7adf98a0a824` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:45.679092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8da89c07524ce4831a7adf98a0a824)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:45.681018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:45.755131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8da89c07524ce4831a7adf98a0a824', 'request_id': 'req-dd87263b-3cfb-413c-9895-366ee64251d3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.764054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8da89c07524ce4831a7adf98a0a824', 'request_id': 'req-dd87263b-3cfb-413c-9895-366ee64251d3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.771726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8da89c07524ce4831a7adf98a0a824', 'request_id': 'req-dd87263b-3cfb-413c-9895-366ee64251d3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.787896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] The token cache is being invalidate because project 2d8da89c07524ce4831a7adf98a0a824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:45.788241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.788888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.791152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1274/2542] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:45 2022] DELETE /identity/v3/projects/2d8da89c07524ce4831a7adf98a0a824 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:45.795105 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:45.806874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ff8a-4639-4e24-b997-f7952b86129b service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:45.870276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:45.871039 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:45.871570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:45.872042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] PATH_INFO: `/v3/users/32b11b3ccf8f434ab049e094b4e1e76f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:45.873503 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b11b3ccf8f434ab049e094b4e1e76f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:45.875665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:45.964085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b11b3ccf8f434ab049e094b4e1e76f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.972515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b11b3ccf8f434ab049e094b4e1e76f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.973322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b11b3ccf8f434ab049e094b4e1e76f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.974581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b11b3ccf8f434ab049e094b4e1e76f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:45.990594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b11b3ccf8f434ab049e094b4e1e76f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.010731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1269/2543] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:45 2022] DELETE /identity/v3/users/32b11b3ccf8f434ab049e094b4e1e76f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:46.553749 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:46.555296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:46.571713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87263b-3cfb-413c-9895-366ee64251d3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:46.658488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:46.659627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:46.660154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:46.660803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] PATH_INFO: `/v3/projects/b48c687e211e4886997a0743a80e303d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:46.662973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48c687e211e4886997a0743a80e303d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:46.666085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:46.673307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:46.723965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48c687e211e4886997a0743a80e303d', 'request_id': 'req-03cd8c9c-0b83-4577-a4ea-54cef95b591d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.734212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48c687e211e4886997a0743a80e303d', 'request_id': 'req-03cd8c9c-0b83-4577-a4ea-54cef95b591d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.741795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48c687e211e4886997a0743a80e303d', 'request_id': 'req-03cd8c9c-0b83-4577-a4ea-54cef95b591d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.754116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:46.755842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:46.756781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] The token cache is being invalidate because project b48c687e211e4886997a0743a80e303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:46.757080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.757791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-03cd8c9c-0b83-4577-a4ea-54cef95b591d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.759601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1275/2544] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:46 2022] DELETE /identity/v3/projects/b48c687e211e4886997a0743a80e303d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:46.764035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e104b-f39f-43a5-963d-4eba3666bc4f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:46.764322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e104b-f39f-43a5-963d-4eba3666bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:46.764616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e104b-f39f-43a5-963d-4eba3666bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:46.768072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:46.772670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16508aa-f613-4f0e-92b4-ac21e8330d60 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:46.787538 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d46e104b-f39f-43a5-963d-4eba3666bc4f None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:46.788750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d46e104b-f39f-43a5-963d-4eba3666bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:46.832731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:46.833498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:46.833848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:46.834196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] PATH_INFO: `/v3/users/dd02eac802ef4cfb81f8670124bc894f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:46.835355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd02eac802ef4cfb81f8670124bc894f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:46.837307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:46.852442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1276/2545] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:46.861096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:46.861412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:46.861690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:46.884430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:46.885710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:46.894321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1277/2546] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:46.894473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd02eac802ef4cfb81f8670124bc894f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.898509 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:46.906865 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd02eac802ef4cfb81f8670124bc894f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.907824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd02eac802ef4cfb81f8670124bc894f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.908379 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd30f-a887-4b66-85d9-38f8850720fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:46.908769 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd02eac802ef4cfb81f8670124bc894f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.913536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:46.914060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:46.914361 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:46.914616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:46.915303 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:46.915613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:46.917198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:46.923725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd02eac802ef4cfb81f8670124bc894f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:46.929142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1278/2547] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:10:46.933946 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:46.935635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:46.938143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1270/2548] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:46 2022] DELETE /identity/v3/users/dd02eac802ef4cfb81f8670124bc894f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:46.948719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e074352-e686-4d92-9c13-bd60168c8053 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.004459 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.005087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.005484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.005773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.006437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.008612 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.032316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.044321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1279/2549] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:46 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:47.045916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.056825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1051c-ecf0-4209-931e-af0cd520b1e5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.115431 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.115918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.116202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.116479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.117148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.118834 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.119116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.120614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.145920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1271/2550] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:47.146986 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e8cc-9af2-427e-be34-fddeafbe6364 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.149903 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.152105 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.152809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.153032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.153339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] PATH_INFO: `/v3/projects/2606969f81ab44ae90b579fb9dc56f56` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.154534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2606969f81ab44ae90b579fb9dc56f56)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.157124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.161494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930492-d64e-49db-8425-f1b15eecd36d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.166362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.166970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.167263 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.167526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.168211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.170131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.179821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1272/2551] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:47.183695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.189381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.194890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93f2e6-d0a3-4571-b6ec-16e848731b0b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.209725 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2606969f81ab44ae90b579fb9dc56f56', 'request_id': 'req-7bd8ce0f-8b5c-40e6-808f-2562a712efea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.217432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2606969f81ab44ae90b579fb9dc56f56', 'request_id': 'req-7bd8ce0f-8b5c-40e6-808f-2562a712efea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.223801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2606969f81ab44ae90b579fb9dc56f56', 'request_id': 'req-7bd8ce0f-8b5c-40e6-808f-2562a712efea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.234662 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] The token cache is being invalidate because project 2606969f81ab44ae90b579fb9dc56f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:47.234932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.235735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7bd8ce0f-8b5c-40e6-808f-2562a712efea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.237244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1280/2552] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:47 2022] DELETE /identity/v3/projects/2606969f81ab44ae90b579fb9dc56f56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:47.241957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099d3e-ed65-4ede-ab1c-24ba8124698b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.242260 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099d3e-ed65-4ede-ab1c-24ba8124698b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.242534 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099d3e-ed65-4ede-ab1c-24ba8124698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.256785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.257447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.257732 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.258011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.258701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.260329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.261481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-05099d3e-ed65-4ede-ab1c-24ba8124698b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:47.262691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-05099d3e-ed65-4ede-ab1c-24ba8124698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.270455 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1273/2553] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:47.271595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1281/2554] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:47.274541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.276152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.278905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.279271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.279633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.290211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6743-d467-42ad-97c1-6b7ba01f70e7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.294851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.295517 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.295799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.296077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] PATH_INFO: `/v3/projects/988a67a8c7c64a638cb51b71303b947f/users/67f7154581bc4393b0fa2670727f956c/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.300223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:47.301458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.310331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1282/2555] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:47.311086 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] RBAC: Authorizing `identity:create_grant(project_id=988a67a8c7c64a638cb51b71303b947f, user_id=67f7154581bc4393b0fa2670727f956c, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.314058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4efdb-b195-49b7-9a49-3f0af262964d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.314835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.324533 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618beb0b-ad26-448e-a598-534b8b69f06a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.326758 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1274/2556] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:47 2022] PUT /identity/v3/projects/988a67a8c7c64a638cb51b71303b947f/users/67f7154581bc4393b0fa2670727f956c/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:47.338798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.339180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.339459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.366652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] MFA Rules not processed for user `67f7154581bc4393b0fa2670727f956c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:47.367861 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.380223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.380847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.381113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.381423 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.382107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:47.382409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.384010 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.395760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1283/2557] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:10:47.400144 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.411632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e92b-a7ad-4e30-876a-5f472564b5d7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.417133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.417818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.418085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.418357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.419020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.420896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.439120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1275/2558] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:47.454306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1284/2559] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:47.454791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.455504 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.456433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.506610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.529252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43824e-4f51-4ac7-b051-7d34e62d8bfd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.530340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36ddb-9106-4f74-a54a-46bc93804a88 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.534968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.535607 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.538450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.538450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.538450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.541720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.554137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.566626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1285/2560] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:47.568028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.578613 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cd50-d036-44b9-89e5-2f8de80e9b31 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.583670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.584291 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.584575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.587332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.587332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.587332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.600771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1286/2561] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:47.600914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.600914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.600914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.600914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.602487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.614787 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe8cb-0f42-4cea-a64d-4b0343ea5b89 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.620480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.621171 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.621721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.622003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.623053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.625414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.642983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1287/2562] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:47.644107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.656318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe74bf-03e2-4138-a4a6-7fba8167c3c3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.661953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.663794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.664338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.664746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] PATH_INFO: `/v3/projects/e24046d87dae4dcda2cd203b7fa96add/users/634b0d854b8a41878bc842d2d9cc8619/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.672875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.674451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.682588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24046d87dae4dcda2cd203b7fa96add, user_id=634b0d854b8a41878bc842d2d9cc8619, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.685206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1276/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:47.693531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6283f-d228-4a83-a11b-38ba0eadbc68 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.708752 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.711644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1288/2564] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:47 2022] PUT /identity/v3/projects/e24046d87dae4dcda2cd203b7fa96add/users/634b0d854b8a41878bc842d2d9cc8619/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:47.723687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0c16-fcec-48de-805f-feac265fa0f1 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.728023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.728320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.728595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.758074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] MFA Rules not processed for user `634b0d854b8a41878bc842d2d9cc8619`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:47.759407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.782577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.783227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.783642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.783923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] PATH_INFO: `/v3/users/67f7154581bc4393b0fa2670727f956c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.785543 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f7154581bc4393b0fa2670727f956c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.787978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.830394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1289/2565] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:47.835161 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.838830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f7154581bc4393b0fa2670727f956c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.846197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f7154581bc4393b0fa2670727f956c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.846679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901b350-5366-4a57-beaf-1a64c866d770 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.846901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f7154581bc4393b0fa2670727f956c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.847511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f7154581bc4393b0fa2670727f956c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.852494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.853189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.853630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.853919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.855131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.856772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.863914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3a378ec0-e0d8-47c5-9a1c-b9382cdf32be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f7154581bc4393b0fa2670727f956c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:47.867025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.880857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1277/2566] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:47 2022] DELETE /identity/v3/users/67f7154581bc4393b0fa2670727f956c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:47.885449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.885897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.886226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.894745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1290/2567] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:47.895973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.897610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.906002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:47.907324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.952330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:47.966213 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc3058-d6b6-442e-85cd-db120254786f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:47.970909 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:47.971525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:47.971934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:47.972158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1278/2568] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:47.972415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:47.974029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:47.976100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:47.981859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:47.983196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:47.998764 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1291/2569] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:47 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:48.003451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.012983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e24e58-dfe0-428b-a934-3f9b23a26b0a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.017867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.018562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.018912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.019223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.019923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.021557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.031994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1292/2570] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:48.035926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.042720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b074f-2575-4ff4-8387-f79d53f34e41 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.045219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c4ca-00c1-45c6-bc63-7b37bb76f1e9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.046898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.047575 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.047923 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.048137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.050282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.050920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.051209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.051490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] PATH_INFO: `/v3/projects/b5afd3686d83464083a2cdf5e58811b8/users/21537c3ac5fd4f659079db1b2fe8b56c/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.057292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.058719 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.067701 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5afd3686d83464083a2cdf5e58811b8, user_id=21537c3ac5fd4f659079db1b2fe8b56c, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.069899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1279/2571] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:48.070544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.085096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1293/2572] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:48 2022] PUT /identity/v3/projects/b5afd3686d83464083a2cdf5e58811b8/users/21537c3ac5fd4f659079db1b2fe8b56c/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:48.089125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.099436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfdc06-b367-41f2-8196-dcfbae591ea3 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.174229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.175107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.175532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.175876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.176586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.178258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739db259-20cc-43d1-bb92-3ac42a8550ff admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.189794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1280/2573] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:48.193951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.204566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef22b6-33e0-42d4-bcad-bf9c37084383 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.210035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.210755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.211126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.211331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] PATH_INFO: `/v3/projects/b5afd3686d83464083a2cdf5e58811b8/users/21537c3ac5fd4f659079db1b2fe8b56c/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.213367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5afd3686d83464083a2cdf5e58811b8, user_id=21537c3ac5fd4f659079db1b2fe8b56c, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.216791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.239229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1294/2574] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:48 2022] PUT /identity/v3/projects/b5afd3686d83464083a2cdf5e58811b8/users/21537c3ac5fd4f659079db1b2fe8b56c/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:48.250652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.250974 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.251215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.281905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] MFA Rules not processed for user `21537c3ac5fd4f659079db1b2fe8b56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:48.283332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.303622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:48.356658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1281/2575] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:48.368304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.368469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.369893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.370395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.436532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d7c1-822f-4981-998a-8b19ad870438 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.440852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.441503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.441785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.442058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.448315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada43e8-2045-4ed0-8309-7eda6ce2128b None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.451090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.452638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581e003-0d48-4c11-baff-775884ef47c3 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.453964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.454603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.454888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.455165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] PATH_INFO: `/v3/projects/988a67a8c7c64a638cb51b71303b947f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.456334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988a67a8c7c64a638cb51b71303b947f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.458303 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.463091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1295/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:48.508581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988a67a8c7c64a638cb51b71303b947f', 'request_id': 'req-598f8f90-49f7-4537-86f1-1212348035a6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.517608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988a67a8c7c64a638cb51b71303b947f', 'request_id': 'req-598f8f90-49f7-4537-86f1-1212348035a6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.525072 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988a67a8c7c64a638cb51b71303b947f', 'request_id': 'req-598f8f90-49f7-4537-86f1-1212348035a6'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.541424 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] The token cache is being invalidate because project 988a67a8c7c64a638cb51b71303b947f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:48.541726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.542422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-598f8f90-49f7-4537-86f1-1212348035a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.544011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1282/2577] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:48 2022] DELETE /identity/v3/projects/988a67a8c7c64a638cb51b71303b947f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:48.549346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.549639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.549919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.569536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:48.570876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.632843 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1296/2578] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:48.640437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.640726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.641007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.663565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:48.665770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.678928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1283/2579] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:48.680497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.691558 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd773bb-cf86-4963-ae1d-d3f6da0672b2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.696389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.697003 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.697312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.697753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.698453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:48.698759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.700357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.714356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1297/2580] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:48.718566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.727586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5128118-1fd9-40a9-a760-cbba00522e2d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.735986 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.736555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.736830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.737157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.737810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.739718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.772823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1284/2581] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:48 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:48.773887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.784202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134f30-6c36-4128-9238-4b674bb290e3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.821965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:48.849288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.851193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.879016 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.879736 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.880090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.880444 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.881197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.883503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.885411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:48.913248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1298/2582] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:48 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:48.914139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.915979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.927782 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1befca4-31f5-4d8e-8655-5f71be3e587a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.928204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c1c37-fd23-4087-bf82-e9296b02df7b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.931392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.932002 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.932288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.932559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.933029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.933763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.934131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.934295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:48.934430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] PATH_INFO: `/v3/users/634b0d854b8a41878bc842d2d9cc8619` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.935567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634b0d854b8a41878bc842d2d9cc8619)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.937630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.946944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.948299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.958312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1285/2583] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:48.959103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:48.973173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2fde4-bb54-4262-9bf8-cba380a23009 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:48.979360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:48.980056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:48.980410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:48.980788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:48.981573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:48.983252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:48.987847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634b0d854b8a41878bc842d2d9cc8619'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.995924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1286/2584] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:48.996604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634b0d854b8a41878bc842d2d9cc8619'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.997296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634b0d854b8a41878bc842d2d9cc8619'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:48.999947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.011031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634b0d854b8a41878bc842d2d9cc8619'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.011237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1de0e-7ab2-4ba9-88a7-836f3680b144 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.011753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b1373955-15d8-4820-9a6d-1b33d4ec7a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634b0d854b8a41878bc842d2d9cc8619'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.016907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.017561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.017844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.018118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.018809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.020404 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.028441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1299/2585] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:48 2022] DELETE /identity/v3/users/634b0d854b8a41878bc842d2d9cc8619 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:49.031403 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1287/2586] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:49.033560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.033852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.034133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.035550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.037332 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.051354 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9c06-7b08-4e92-80d6-74ff3f1805f8 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.055926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:49.057756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.113702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.114485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.114847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.115206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] PATH_INFO: `/v3/projects/6e4b0b47db82461ba7c2d0db20a1a6f8/users/fc9c44c257ae4d97a2120ee6219f7169/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.130413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4b0b47db82461ba7c2d0db20a1a6f8, user_id=fc9c44c257ae4d97a2120ee6219f7169, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.133175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f953af-281e-49ab-8d50-b762513e861f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.135152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1300/2587] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:49.145715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.147417 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.151025 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1288/2588] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:49 2022] PUT /identity/v3/projects/6e4b0b47db82461ba7c2d0db20a1a6f8/users/fc9c44c257ae4d97a2120ee6219f7169/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:49.162492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.163296 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.163920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.188306 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:49.195316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] MFA Rules not processed for user `fc9c44c257ae4d97a2120ee6219f7169`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:49.197243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.221463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43db8a-5a7e-417f-ad4c-ee4a5c223f7b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.270696 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1289/2589] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:49.275059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.277028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.277670 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.277955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.278235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.292178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:49.348736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33abc9-aaac-4a24-bb16-78f6025611f5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.349996 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.351643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.353518 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.354214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.354565 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.354905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.355639 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.357902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.361729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1301/2590] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:49.393310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1290/2591] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:49.395492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.407876 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e1d92-41db-47b8-aeab-f81c6cea8003 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.476233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.477321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.477747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.477884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.478586 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.481290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.510122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1302/2592] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:49.514321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.539554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68ef4-1110-408e-ab7b-b2f746f82235 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.545046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.545706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.545987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.546853 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.547857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.549197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.560590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1291/2593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:49.565031 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.577018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6245b9-5c1f-4985-b37e-2041242fad72 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.582468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.583246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.583601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.583953 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.584739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.586530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.601221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1303/2594] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:49.601905 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.614488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218db0e-890f-42ff-b25b-201fc8b39a4c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.621077 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.621886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.622235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.622583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] PATH_INFO: `/v3/projects/4b77bb17389244ba913d938a3812e125/users/fd82b4bcb6d64e2593e23b3e29db8f0d/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.640584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b77bb17389244ba913d938a3812e125, user_id=fd82b4bcb6d64e2593e23b3e29db8f0d, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.643748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1f406-4617-4266-b542-bd09906cf71b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.662314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1292/2595] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:49 2022] PUT /identity/v3/projects/4b77bb17389244ba913d938a3812e125/users/fd82b4bcb6d64e2593e23b3e29db8f0d/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:49.670697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.673173 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.688880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772f03-9fee-42a1-925c-1a4ae5c5e7fe admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.701413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:49.742159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.742347 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.742838 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.772380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.772854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] MFA Rules not processed for user `fd82b4bcb6d64e2593e23b3e29db8f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:49.773034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.773343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.773637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] PATH_INFO: `/v3/projects/e24046d87dae4dcda2cd203b7fa96add` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.774244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.774810 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24046d87dae4dcda2cd203b7fa96add)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.776997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.850934 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24046d87dae4dcda2cd203b7fa96add', 'request_id': 'req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.853106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1293/2596] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:49.858206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.861930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24046d87dae4dcda2cd203b7fa96add', 'request_id': 'req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.870387 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24046d87dae4dcda2cd203b7fa96add', 'request_id': 'req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.877673 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbe849-4107-4734-b06b-97d2d19532bb None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.882225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] The token cache is being invalidate because project e24046d87dae4dcda2cd203b7fa96add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:49.882535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.883269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:49.885142 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1304/2597] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:49 2022] DELETE /identity/v3/projects/e24046d87dae4dcda2cd203b7fa96add => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:49.888813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.891023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:49.941305 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:49.954907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:49.956162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:49.956456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:49.956740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:49.957688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:49.959552 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:49.986753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165c2e-5ccc-4efe-9441-04ea5f0a5cec admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:49.989092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1294/2598] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:49.993162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:49.994902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.052619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:50.072222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.073151 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.073638 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.074786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] PATH_INFO: `/v3/users/21537c3ac5fd4f659079db1b2fe8b56c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.076053 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3cee-3d01-4aa1-a188-0e8fade7d776 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.076590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21537c3ac5fd4f659079db1b2fe8b56c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.080503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.084202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.085126 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.085998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.086278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.087127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.090081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.133450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1295/2599] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:49 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:50.137141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.158842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1458e16-31f9-4715-8b5a-c894d6039fa2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.168148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21537c3ac5fd4f659079db1b2fe8b56c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.170911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.171675 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.171955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.172231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.173295 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.174884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.185923 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21537c3ac5fd4f659079db1b2fe8b56c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.188598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21537c3ac5fd4f659079db1b2fe8b56c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.193333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1296/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:50.196654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.204952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21537c3ac5fd4f659079db1b2fe8b56c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.205948 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21537c3ac5fd4f659079db1b2fe8b56c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.209881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127b294-20e2-4fd5-86af-045e9824f82a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.217730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.219283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.219646 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.220031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] PATH_INFO: `/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7/users/070ae01a2105471b96958350caf91dbb/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.220475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1305/2601] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:49 2022] DELETE /identity/v3/users/21537c3ac5fd4f659079db1b2fe8b56c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:50.237250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386d2c67ba24b1381c5288ab7c2b2f7, user_id=070ae01a2105471b96958350caf91dbb, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.240115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.256450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1297/2602] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:50 2022] PUT /identity/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7/users/070ae01a2105471b96958350caf91dbb/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:50.260481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.261952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.349310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424901-7afb-4020-9633-6fb68fda5e1f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.430570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.431826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.432337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.432754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.433502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.435982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b7df-b24d-442c-940e-bf308fdfcff1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.448865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1306/2603] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:50.453183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.464051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43427b-784a-4fc4-80b5-34ed7d044820 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.470014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.470692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.470978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.471258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] PATH_INFO: `/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7/users/070ae01a2105471b96958350caf91dbb/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.473228 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f386d2c67ba24b1381c5288ab7c2b2f7, user_id=070ae01a2105471b96958350caf91dbb, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.475943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.491100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1298/2604] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:50 2022] PUT /identity/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7/users/070ae01a2105471b96958350caf91dbb/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:50.501980 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.502392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.502769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.529564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:50.537967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] MFA Rules not processed for user `070ae01a2105471b96958350caf91dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:50.540179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.625034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.626962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.639811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1307/2605] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:50.649299 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:50.650939 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.723576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dc8e4-18a0-46c3-973d-a6f432952be0 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.729146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.729942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.730677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.730677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] PATH_INFO: `/v3/projects/b5afd3686d83464083a2cdf5e58811b8` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.732178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5afd3686d83464083a2cdf5e58811b8)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.734562 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.739114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9cd09-83b7-4e77-9ad7-2f5fcd02b6ff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:50.746062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:50.747212 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.748168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.748616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.751917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.761113 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:50.816239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5afd3686d83464083a2cdf5e58811b8', 'request_id': 'req-2c2966bd-a7dc-4662-b495-2c9652b8f888'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.828401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5afd3686d83464083a2cdf5e58811b8', 'request_id': 'req-2c2966bd-a7dc-4662-b495-2c9652b8f888'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.837090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:50.837669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5afd3686d83464083a2cdf5e58811b8', 'request_id': 'req-2c2966bd-a7dc-4662-b495-2c9652b8f888'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.838711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8e3c-59a0-4902-8b6b-0df1da777aac service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:50.849680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1308/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:50.851213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] The token cache is being invalidate because project b5afd3686d83464083a2cdf5e58811b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:50.851849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.852677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-2c2966bd-a7dc-4662-b495-2c9652b8f888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:50.854670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1299/2607] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:50 2022] DELETE /identity/v3/projects/b5afd3686d83464083a2cdf5e58811b8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:50.863253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.864544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.865044 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:50.889833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:50.891868 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:50.955668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:50.980561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1309/2608] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:50.988111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:50.988482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:50.988835 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.021178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:51.022911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:51.038489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1300/2609] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:51.043177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.056751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37628e-cd18-4a18-887b-19f90de55e59 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.062023 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.063038 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.063489 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.063769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.064642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:51.064962 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.067541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.087831 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1310/2610] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:51.090379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.107117 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7506-dc64-42fc-8195-e988b0f74928 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.123395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.124822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.125556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.126037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.127435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.130201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.192042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1301/2611] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:51 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:51.196446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.208755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7490-430b-4894-bd5d-9f2ad74ccecc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.291451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.292226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.292605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.292949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.293819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.295859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.324773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1311/2612] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:51 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:51.325739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.337036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7276e8-002e-49eb-b507-a0bbe9181721 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.341832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.342446 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.342726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.343034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.343748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.346579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.357084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1302/2613] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:51.361125 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.371726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6aec-445f-4164-9ae3-c0253eceadfa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.377657 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.378311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.378595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.378872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.379598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.381192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427823ea-cf03-4553-bd51-ba38d39aa6ce admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.393203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1312/2614] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:51.397615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.409520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4744-1eae-447b-b8ce-757bc96787ef admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.413814 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.414493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.414846 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.415057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] PATH_INFO: `/v3/projects/74ffc2d32d34432ab509a5199e9390eb/users/11e2f791b9d8453aa142e6ea3e4edfc5/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.432683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ffc2d32d34432ab509a5199e9390eb, user_id=11e2f791b9d8453aa142e6ea3e4edfc5, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.435319 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.450574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1303/2615] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:51 2022] PUT /identity/v3/projects/74ffc2d32d34432ab509a5199e9390eb/users/11e2f791b9d8453aa142e6ea3e4edfc5/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:51.463958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.463958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.464181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.497928 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] MFA Rules not processed for user `11e2f791b9d8453aa142e6ea3e4edfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:51.499751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:51.580446 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1313/2616] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:51.585298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.662561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdab6-9780-4931-8b5e-5d735a6738ad admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.668285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.669087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.669484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.669856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.670588 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.673081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.713309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1304/2617] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:51 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:51.715552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.726754 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eebf-fe5a-4e1e-88d0-6314748369fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.790221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:51.808784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.809926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.810286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.810634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.811930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.814004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.842071 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1314/2618] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:51 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:51.843691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.855602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71c67b-a330-4cae-90ad-ddf02bb0b999 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.867435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.868081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.868364 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.868722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.869519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.871168 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.904886 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1305/2619] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:10:51.907762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.919102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877f05-57e3-445c-8203-45abc467e7a3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:51.924742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:51.925494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:51.925779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:51.926060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] PATH_INFO: `/v3/projects/c15a76b8ca884fef9d82503c506e8f74/users/c0640b65a51b496a9e7b6b9eec51717c/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:51.943469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15a76b8ca884fef9d82503c506e8f74, user_id=c0640b65a51b496a9e7b6b9eec51717c, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:51.946337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:51.964284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1315/2620] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:51 2022] PUT /identity/v3/projects/c15a76b8ca884fef9d82503c506e8f74/users/c0640b65a51b496a9e7b6b9eec51717c/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:51.968734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:51.987484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0048c3-f672-4537-855c-c6f01a9af72b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.011829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:52.059527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.060164 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.060451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.060724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.061470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.063812 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78c768-0b6a-4c83-b599-3318283d919e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.075813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1306/2621] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:52.081158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.092566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa3c1-e91b-4e58-8284-f89cfe4a6609 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.100269 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.100967 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.101254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.101585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] PATH_INFO: `/v3/projects/c15a76b8ca884fef9d82503c506e8f74/users/c0640b65a51b496a9e7b6b9eec51717c/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.117327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15a76b8ca884fef9d82503c506e8f74, user_id=c0640b65a51b496a9e7b6b9eec51717c, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.124259 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.152734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1316/2622] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:52 2022] PUT /identity/v3/projects/c15a76b8ca884fef9d82503c506e8f74/users/c0640b65a51b496a9e7b6b9eec51717c/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:52.163944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.164711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.165098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.206191 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] MFA Rules not processed for user `c0640b65a51b496a9e7b6b9eec51717c`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:52.207457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.329340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1307/2623] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:52.356239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.358148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.362725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.365510 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.482542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468a54-32ce-4faf-a024-82bb9762b3ad admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.485667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de9b9-89de-466a-aba1-62e936ed5a71 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.487234 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.488034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.488267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.488549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.490999 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.491627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.491911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.492185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.493973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.498907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.500521 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.507940 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.509867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.511985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1317/2624] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:52.512827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.514141 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.528288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1308/2625] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:52.547141 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.549133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.564439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f162-78d4-4995-bea2-ab6689c7bb42 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.568726 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.569803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.570386 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.570795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.575012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.594758 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6a83a-7311-48cb-8e09-0aca9f25e976 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.599471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.600119 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.600402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.600679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] PATH_INFO: `/v3/users/0d778a3f7d7e477dbcc4b06ba33ded03` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.601875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d778a3f7d7e477dbcc4b06ba33ded03)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.603789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.607649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:52.641539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.643023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.652494 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:52.652762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1309/2626] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:52.653872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.655130 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d778a3f7d7e477dbcc4b06ba33ded03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.665206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d778a3f7d7e477dbcc4b06ba33ded03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.666630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d778a3f7d7e477dbcc4b06ba33ded03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.668128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335bf56-1266-4cbe-adda-5208f709d6f9 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.673669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.674314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.674660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.674944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] PATH_INFO: `/v3/users/11e2f791b9d8453aa142e6ea3e4edfc5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.676150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e2f791b9d8453aa142e6ea3e4edfc5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.678089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.680608 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d778a3f7d7e477dbcc4b06ba33ded03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.681354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5902b176-a13a-41e6-ba6e-88876a470d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d778a3f7d7e477dbcc4b06ba33ded03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.695085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1318/2627] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:52 2022] DELETE /identity/v3/users/0d778a3f7d7e477dbcc4b06ba33ded03 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:52.739148 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e2f791b9d8453aa142e6ea3e4edfc5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.747418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e2f791b9d8453aa142e6ea3e4edfc5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.748137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e2f791b9d8453aa142e6ea3e4edfc5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.748770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e2f791b9d8453aa142e6ea3e4edfc5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.763282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e2f791b9d8453aa142e6ea3e4edfc5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:52.781177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1310/2628] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:52 2022] DELETE /identity/v3/users/11e2f791b9d8453aa142e6ea3e4edfc5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:52.787165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.787656 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.787742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.810785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:52.812757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.887894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1319/2629] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:52.894988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.896749 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.899560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:52.902957 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:52.914283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02afe-0f5b-4000-9b14-1d0b232ee4c7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.923548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:52.924461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:52.924822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:52.925176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] PATH_INFO: `/v3/projects/7636821f30394d2baae53233ca7affdd` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:52.930622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7636821f30394d2baae53233ca7affdd)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:52.934134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:52.984944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184021-02cb-4045-87f3-b8b9986d1b4b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:52.997011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7636821f30394d2baae53233ca7affdd', 'request_id': 'req-04dde18c-a42c-42ba-b05a-a08371a798dd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.007065 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7636821f30394d2baae53233ca7affdd', 'request_id': 'req-04dde18c-a42c-42ba-b05a-a08371a798dd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.014709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7636821f30394d2baae53233ca7affdd', 'request_id': 'req-04dde18c-a42c-42ba-b05a-a08371a798dd'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.026202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] The token cache is being invalidate because project 7636821f30394d2baae53233ca7affdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:53.026787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.027526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-04dde18c-a42c-42ba-b05a-a08371a798dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.033152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1311/2630] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:52 2022] DELETE /identity/v3/projects/7636821f30394d2baae53233ca7affdd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:53.034748 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987276b3-c4f9-49c8-9694-c9ab4084b813 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.035159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987276b3-c4f9-49c8-9694-c9ab4084b813 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.035574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987276b3-c4f9-49c8-9694-c9ab4084b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.047098 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.047903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.048033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.048398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.051331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.058778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-987276b3-c4f9-49c8-9694-c9ab4084b813 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:53.060293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-987276b3-c4f9-49c8-9694-c9ab4084b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.082032 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:53.095568 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:53.136194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.137690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.138063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1312/2631] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:53.147313 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.147607 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.148019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1320/2632] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:53.149480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.170954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:53.172957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.182736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1313/2633] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:53.187726 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.198002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188aee-5d4a-408d-a847-b773fcd576b8 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.203531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.204184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.204626 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.205121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.205666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:53.205975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.207567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.222305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1321/2634] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:53.226965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.237682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f6d41-c463-467a-b880-ba92c56c5cfa None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.243034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.243659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.243942 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.244219 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.244900 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.246902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.281561 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1314/2635] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:53 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:53.286437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.305104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe92b6-df3a-4496-ba10-dcdb3b9b9a1e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.351757 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.353628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.379897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.380525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.380811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.381090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.381856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.383700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.408439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1322/2636] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:53 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:53.412751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.420329 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4355e9-ca85-4519-9262-90cfdf9b285d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.424155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3503-3b2e-4398-9d7c-77ea7dd15e78 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.424858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.425253 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.425587 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.425850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.428029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.430695 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.431383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.431692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.431976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.432820 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.434536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.453185 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1323/2637] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:53.454432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.466245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e50daf-bef5-4a07-8542-d55e305d4994 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.474441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.474665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.474951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.475227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.475919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.477751 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.489376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1324/2638] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:53.490197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.493742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.503525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.504978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.507793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d449513-e5ce-473a-bd92-5c92c9421e08 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.512735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.513399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.513684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.513966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] PATH_INFO: `/v3/projects/74ffc2d32d34432ab509a5199e9390eb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.515727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ffc2d32d34432ab509a5199e9390eb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.515918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1315/2639] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:53.516709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.517803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.527020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa63e-936d-4864-b6b7-d70d60f80360 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.532194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.532867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.533226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.533630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] PATH_INFO: `/v3/projects/a939bcba6b2641fe8d90c6ae4feadb4f/users/e7485faea40446989f03a585cca70425/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.553558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a939bcba6b2641fe8d90c6ae4feadb4f, user_id=e7485faea40446989f03a585cca70425, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.556408 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a968a-5ee6-49e5-ac14-0c36d953ada2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.572061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1316/2640] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:53 2022] PUT /identity/v3/projects/a939bcba6b2641fe8d90c6ae4feadb4f/users/e7485faea40446989f03a585cca70425/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:53.581959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ffc2d32d34432ab509a5199e9390eb', 'request_id': 'req-7aa267be-aef0-4893-8fd2-e7feac749d69'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.584031 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.584323 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.584804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.585380 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ffc2d32d34432ab509a5199e9390eb', 'request_id': 'req-7aa267be-aef0-4893-8fd2-e7feac749d69'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.591577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ffc2d32d34432ab509a5199e9390eb', 'request_id': 'req-7aa267be-aef0-4893-8fd2-e7feac749d69'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.603545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] The token cache is being invalidate because project 74ffc2d32d34432ab509a5199e9390eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:53.603886 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.604709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.606599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1325/2641] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:53 2022] DELETE /identity/v3/projects/74ffc2d32d34432ab509a5199e9390eb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:53.610588 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.613017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.617023 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] MFA Rules not processed for user `e7485faea40446989f03a585cca70425`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:53.618321 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.621490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:53.628764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:53.689898 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1317/2642] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:53.691149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa267be-aef0-4893-8fd2-e7feac749d69 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.700731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:53.702216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:53.753323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.754127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.754413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.754692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] PATH_INFO: `/v3/users/c0640b65a51b496a9e7b6b9eec51717c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.756069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0640b65a51b496a9e7b6b9eec51717c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.758205 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.763457 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dd2dd-2e38-48a5-b608-4e58cea0b985 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:53.768157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:53.768779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:53.769078 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:53.769362 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:53.779353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:53.780827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:53.791159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1318/2643] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:53.807815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0640b65a51b496a9e7b6b9eec51717c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.816014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0640b65a51b496a9e7b6b9eec51717c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.816851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0640b65a51b496a9e7b6b9eec51717c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.831839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0640b65a51b496a9e7b6b9eec51717c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.832619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbb3fd4d-97ec-4129-949e-078d9b15e82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0640b65a51b496a9e7b6b9eec51717c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:53.846279 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1326/2644] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:53 2022] DELETE /identity/v3/users/c0640b65a51b496a9e7b6b9eec51717c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:54.141462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.157666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40efc-c3ce-4c5a-a55a-ec7a1e2f6e17 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.215576 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.216212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.216490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.216762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] PATH_INFO: `/v3/projects/c15a76b8ca884fef9d82503c506e8f74` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.217949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15a76b8ca884fef9d82503c506e8f74)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.220212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.265968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15a76b8ca884fef9d82503c506e8f74', 'request_id': 'req-166cfaf1-8206-4c1b-b939-5765e7b33f01'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:54.273976 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15a76b8ca884fef9d82503c506e8f74', 'request_id': 'req-166cfaf1-8206-4c1b-b939-5765e7b33f01'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:54.275249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:54.282150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15a76b8ca884fef9d82503c506e8f74', 'request_id': 'req-166cfaf1-8206-4c1b-b939-5765e7b33f01'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:54.294004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] The token cache is being invalidate because project c15a76b8ca884fef9d82503c506e8f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:54.294292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:54.294933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-166cfaf1-8206-4c1b-b939-5765e7b33f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:54.296432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1319/2645] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:54 2022] DELETE /identity/v3/projects/c15a76b8ca884fef9d82503c506e8f74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:54.301196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.301593 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.301949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.321883 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:54.323019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:54.349729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:54.390784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1327/2646] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:54.398557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.398848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.399130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.420020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:54.421432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:54.429706 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1320/2647] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:54.433942 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.444152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f4dd-1892-4e13-9960-c6b1c5aa7931 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.449497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.450113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.450399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.450676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.451367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:54.451682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.453855 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.465536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1328/2648] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:54.469922 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.479250 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15381c12-b53b-4603-b12b-e9492a7a2599 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.484560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.485171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.485490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.485767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.486432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.488326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.516085 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1321/2649] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:54.520289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.534253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b295a-780e-4add-9d25-4c905d3893aa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.589498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.590150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.590454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.590766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.591437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.593457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.614867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1329/2650] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:54.618990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.630061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50860914-d77c-4cdf-b9cd-4173d9035912 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.634660 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.635260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.635539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.635809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.636493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.638133 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.652044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1322/2651] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:54.654352 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.667771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d2e3-e959-44c6-b09f-fb283fb1983f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.673091 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.673744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.674027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.674297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.674988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.676565 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc139a64-986d-400f-8912-0a5503486177 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.690115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1330/2652] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:54.694127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.704307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce82f-d1e0-44ba-ac88-becc5f022580 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.708956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.709648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.709930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.710215 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] PATH_INFO: `/v3/projects/e51978526c8449bdbfac915a235361ec/users/ddcdcb246eae4fdf84095ed576ae50f5/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.729764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51978526c8449bdbfac915a235361ec, user_id=ddcdcb246eae4fdf84095ed576ae50f5, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.735943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.753183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1323/2653] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:54 2022] PUT /identity/v3/projects/e51978526c8449bdbfac915a235361ec/users/ddcdcb246eae4fdf84095ed576ae50f5/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:54.766985 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.767682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.767958 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.797122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] MFA Rules not processed for user `ddcdcb246eae4fdf84095ed576ae50f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:54.798371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:54.871702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1331/2654] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:54.877070 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:54.950839 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24c9f-aff1-49b0-b7de-441496169627 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:54.955811 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:54.956448 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:54.956730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:54.957011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:54.957717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:54.960171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:54.990584 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1324/2655] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:54.994536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.005256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b51b0-9ef3-4a6e-9de4-a299a5c2ab7d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.034241 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:55.068355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.068987 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.069287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.069584 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.070261 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.072340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.094333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1332/2656] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:54 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:55.098486 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.109998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957443b1-cf5f-4c00-bbf3-298f9c9d3e62 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.115136 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.115804 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.116130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.116378 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.117005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.118625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.132564 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1325/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:55.134389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.145048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196719fc-e2f7-4790-adc8-2fc9179523a2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.151616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.152497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.152844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.153122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] PATH_INFO: `/v3/projects/c96ac41754c545caae4d4a2bd999a565/users/2985229745b5476ea9eab481b09ddc0b/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.169679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ac41754c545caae4d4a2bd999a565, user_id=2985229745b5476ea9eab481b09ddc0b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.172984 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.187040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1333/2658] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:55 2022] PUT /identity/v3/projects/c96ac41754c545caae4d4a2bd999a565/users/2985229745b5476ea9eab481b09ddc0b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:55.191120 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.201779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1242667-a68e-40c5-a003-e9ecb952a898 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.252573 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:55.262122 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.263128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.263416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.263877 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.264876 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.274185 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ab15-e199-45db-b994-460e93ee9881 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.290577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1326/2659] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:55.294784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.306280 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcc80b-671e-4450-8bc2-0d42c1bd4b35 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.312794 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.313553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.313890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.314178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] PATH_INFO: `/v3/projects/c96ac41754c545caae4d4a2bd999a565/users/2985229745b5476ea9eab481b09ddc0b/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.316282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ac41754c545caae4d4a2bd999a565, user_id=2985229745b5476ea9eab481b09ddc0b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.318955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.330201 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1334/2660] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:55 2022] PUT /identity/v3/projects/c96ac41754c545caae4d4a2bd999a565/users/2985229745b5476ea9eab481b09ddc0b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:55.341429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.342356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.342356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.372342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] MFA Rules not processed for user `2985229745b5476ea9eab481b09ddc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:55.373501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:55.447928 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1327/2661] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:55.459630 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.461447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:55.545785 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b54d0-a900-4473-944d-9880b2eaab10 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.549673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.550304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.550585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.550862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.561133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.562636 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeecfb3-94e5-4886-b98d-01381f0daed3 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.572543 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1335/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:55.637574 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.701274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6607c3-a1ff-4e80-bad5-887bf430750a None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.706627 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.707266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.707555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.707834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] PATH_INFO: `/v3/users/ddcdcb246eae4fdf84095ed576ae50f5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.709005 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcdcb246eae4fdf84095ed576ae50f5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.710949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.756383 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcdcb246eae4fdf84095ed576ae50f5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:55.763177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcdcb246eae4fdf84095ed576ae50f5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:55.763841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcdcb246eae4fdf84095ed576ae50f5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:55.764456 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcdcb246eae4fdf84095ed576ae50f5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:55.777018 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcdcb246eae4fdf84095ed576ae50f5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:55.780585 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:55.792324 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1328/2663] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:55 2022] DELETE /identity/v3/users/ddcdcb246eae4fdf84095ed576ae50f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:55.796879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.797199 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.797513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.816696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:55.818061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:55.880278 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1336/2664] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:55.890482 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:55.892067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:55.950340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc363-40ad-4cb8-927d-44fefc668539 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:55.954649 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:55.955270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:55.955556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:55.955837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:55.965501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:55.966939 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:55.977127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1329/2665] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:56.267149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:56.269680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:56.282040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cdaa7-f135-4466-b9b0-0a9c1109fdbf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:56.286802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:56.287484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:56.287800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:56.288188 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] PATH_INFO: `/v3/projects/e51978526c8449bdbfac915a235361ec` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:56.299363 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51978526c8449bdbfac915a235361ec)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:56.302358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:56.323486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:56.359884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51978526c8449bdbfac915a235361ec', 'request_id': 'req-fbdc9988-5617-4888-a490-73d4d4f69594'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.370118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51978526c8449bdbfac915a235361ec', 'request_id': 'req-fbdc9988-5617-4888-a490-73d4d4f69594'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.376561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51978526c8449bdbfac915a235361ec', 'request_id': 'req-fbdc9988-5617-4888-a490-73d4d4f69594'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.389473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] The token cache is being invalidate because project e51978526c8449bdbfac915a235361ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:56.390254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.390893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.392454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1337/2666] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:56 2022] DELETE /identity/v3/projects/e51978526c8449bdbfac915a235361ec => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:56.396416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:56.406956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed493f-6c01-43af-8dee-cc88d4c33383 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:56.467525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:56.468207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:56.468524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:56.468805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] PATH_INFO: `/v3/users/2985229745b5476ea9eab481b09ddc0b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:56.470029 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2985229745b5476ea9eab481b09ddc0b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:56.472293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:56.520989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2985229745b5476ea9eab481b09ddc0b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.528245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2985229745b5476ea9eab481b09ddc0b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.528911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2985229745b5476ea9eab481b09ddc0b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.529548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2985229745b5476ea9eab481b09ddc0b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.541430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f235a750-03eb-4296-9460-909c361fb27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2985229745b5476ea9eab481b09ddc0b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:56.554421 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1330/2667] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:56 2022] DELETE /identity/v3/users/2985229745b5476ea9eab481b09ddc0b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:56.843547 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:56.845104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:56.861945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9988-5617-4888-a490-73d4d4f69594 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:56.933940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:56.934696 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:56.935412 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:56.935700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] PATH_INFO: `/v3/projects/c96ac41754c545caae4d4a2bd999a565` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:56.937486 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96ac41754c545caae4d4a2bd999a565)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:56.939409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:56.996103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96ac41754c545caae4d4a2bd999a565', 'request_id': 'req-5c584e49-95bc-4d35-8fb8-73c73603a34a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.004671 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96ac41754c545caae4d4a2bd999a565', 'request_id': 'req-5c584e49-95bc-4d35-8fb8-73c73603a34a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.010328 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96ac41754c545caae4d4a2bd999a565', 'request_id': 'req-5c584e49-95bc-4d35-8fb8-73c73603a34a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.021801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] The token cache is being invalidate because project c96ac41754c545caae4d4a2bd999a565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:57.022087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.022734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5c584e49-95bc-4d35-8fb8-73c73603a34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.024221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1338/2668] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:56 2022] DELETE /identity/v3/projects/c96ac41754c545caae4d4a2bd999a565 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:57.029487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.029778 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.030058 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.049767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:57.050972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.063485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:57.110557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1331/2669] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:57.119008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.119307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.119617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.140821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:57.142065 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.149976 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1339/2670] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:57.154379 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.164551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df508cf-6753-4ede-957e-e35a3ba99095 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.169237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.169919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.170203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.170480 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.171266 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:57.171806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.173578 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.185239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1332/2671] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:57.190327 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.199433 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c15f-b0f8-489b-976a-d910ad48e2d4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.204718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.205357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.205643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.205919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.206590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.208469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.238164 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1340/2672] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:57.239356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.249836 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9348a73-7eb1-40a2-aaaa-f10f92a6943d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.305907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.306570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.306857 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.307149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.307810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.309776 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.332800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1333/2673] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/users => generated 304 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:57.336861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.347275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fee971-5606-4a26-bfeb-b3b97d711eaa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.351877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.352491 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.352778 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.353056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.353783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.355436 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.356685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:57.369075 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1341/2674] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:57.372947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.383893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12082-2497-42e8-9175-1ef0b4b08934 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.388512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.389171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.389484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.390365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.391066 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.392670 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.407935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1334/2675] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:57.410069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.423561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b004cd5-e695-477d-99f1-961fe355d751 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.428918 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.429675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.429961 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.430238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] PATH_INFO: `/v3/projects/35543a695fd74544a4d9ae02db2f8e2c/users/13779d9a406940e5a89ef404207225bc/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.445411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35543a695fd74544a4d9ae02db2f8e2c, user_id=13779d9a406940e5a89ef404207225bc, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.448051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038c4d8-9a95-4b2c-8872-01109500ba0e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.449384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.451200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.464535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1342/2676] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:57 2022] PUT /identity/v3/projects/35543a695fd74544a4d9ae02db2f8e2c/users/13779d9a406940e5a89ef404207225bc/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:57.469572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d791-b0eb-44db-9d1d-86c3457b9f9f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.531535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.532244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.532538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.532920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] PATH_INFO: `/v3/users/fc9c44c257ae4d97a2120ee6219f7169` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.534026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9c44c257ae4d97a2120ee6219f7169)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.535957 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.539068 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.539353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.539750 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.566849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:57.569341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] MFA Rules not processed for user `13779d9a406940e5a89ef404207225bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:57.570605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.587542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9c44c257ae4d97a2120ee6219f7169'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.594824 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9c44c257ae4d97a2120ee6219f7169'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.595499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9c44c257ae4d97a2120ee6219f7169'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.596131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9c44c257ae4d97a2120ee6219f7169'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.609024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3182402f-163b-4514-8c9a-4b095dfb32c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9c44c257ae4d97a2120ee6219f7169'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:57.622242 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1335/2677] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:57 2022] DELETE /identity/v3/users/fc9c44c257ae4d97a2120ee6219f7169 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:57.627179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.627463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.627742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.639564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1343/2678] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:57.643536 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.644836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.646605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:57.647780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.658564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2883d-564a-4912-a405-adbe3c07af39 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.710288 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1336/2679] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:10:57.717476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.718137 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.718422 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.718784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.719450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.719703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.721051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:57.721441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.749595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1344/2680] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:10:57.754404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.783094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd478b87-5a26-4725-a852-9a190ee5f143 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.806692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:57.823034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8b85-a912-4d70-8aaa-b957867f832d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.828372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.829019 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.829335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.829620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.830330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.832257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.833829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.834597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.834885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.835162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.845366 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.847244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.856053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1345/2681] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:10:57 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:10:57.857921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1337/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:10:57.862430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.872597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418dda9-1557-484f-881a-f0da836d3937 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.878305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.879389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.879679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.879959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.881335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.882989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.894824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1346/2683] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:57.899104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.904698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:57.910904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3be8c-5005-471e-a40a-c426bad793c3 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:57.917106 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:57.917912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:57.918280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:57.918663 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] PATH_INFO: `/v3/projects/2ac6048992854e87aecb00c23fee7b1b/users/25b58c41c69a4ecab7ee9d22a488c89b/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:57.936711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac6048992854e87aecb00c23fee7b1b, user_id=25b58c41c69a4ecab7ee9d22a488c89b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:57.939509 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:57.953099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1338/2684] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:57 2022] PUT /identity/v3/projects/2ac6048992854e87aecb00c23fee7b1b/users/25b58c41c69a4ecab7ee9d22a488c89b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:57.957418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:57.970415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0ebb9-8ec3-4bde-9888-d48ebd356e8c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.051302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.052103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.053155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.053155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.061832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.064235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7f91-56b1-4d40-ba71-e86ec00f68af admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.081676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1347/2685] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:10:58.085629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:58.097692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26093d99-0329-432f-97d6-52e9e5dccd7c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.103104 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.103788 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.107556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.116882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] PATH_INFO: `/v3/projects/2ac6048992854e87aecb00c23fee7b1b/users/25b58c41c69a4ecab7ee9d22a488c89b/roles/37946d08da58471c9678da91450dd183` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.122779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac6048992854e87aecb00c23fee7b1b, user_id=25b58c41c69a4ecab7ee9d22a488c89b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.125566 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.160123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1339/2686] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:10:58 2022] PUT /identity/v3/projects/2ac6048992854e87aecb00c23fee7b1b/users/25b58c41c69a4ecab7ee9d22a488c89b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:58.170570 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.170912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.171121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.188826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:58.194121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.207431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] MFA Rules not processed for user `25b58c41c69a4ecab7ee9d22a488c89b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:58.209157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.297037 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768ab1d-0904-4fc9-82f5-c99bdde661de admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.303466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.304432 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.305217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.305729 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] PATH_INFO: `/v3/projects/6e4b0b47db82461ba7c2d0db20a1a6f8` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.306984 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4b0b47db82461ba7c2d0db20a1a6f8)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.309075 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.316676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1348/2687] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:58.334833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:58.336994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.402875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4b0b47db82461ba7c2d0db20a1a6f8', 'request_id': 'req-697f7087-0e7b-48ea-bb5d-8365973bd65b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.412057 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4b0b47db82461ba7c2d0db20a1a6f8', 'request_id': 'req-697f7087-0e7b-48ea-bb5d-8365973bd65b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.416138 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:58.420844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4b0b47db82461ba7c2d0db20a1a6f8', 'request_id': 'req-697f7087-0e7b-48ea-bb5d-8365973bd65b'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.424059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834e0e-064e-4c53-9c07-9c58fbab2d7d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.433056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] The token cache is being invalidate because project 6e4b0b47db82461ba7c2d0db20a1a6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:58.433467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.434261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.436730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1340/2688] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:58 2022] DELETE /identity/v3/projects/6e4b0b47db82461ba7c2d0db20a1a6f8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:58.440427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:58.441909 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.486320 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.487043 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.487443 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.487782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.489680 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.512716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:58.519715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f7087-0e7b-48ea-bb5d-8365973bd65b admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.526461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.527533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.527964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.528302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] PATH_INFO: `/v3/users/fd82b4bcb6d64e2593e23b3e29db8f0d` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.531338 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd82b4bcb6d64e2593e23b3e29db8f0d)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.533277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.573232 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.574830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.586147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd82b4bcb6d64e2593e23b3e29db8f0d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.586427 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1349/2689] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:58.594355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd82b4bcb6d64e2593e23b3e29db8f0d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.594937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd82b4bcb6d64e2593e23b3e29db8f0d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.595581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd82b4bcb6d64e2593e23b3e29db8f0d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.611837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd82b4bcb6d64e2593e23b3e29db8f0d'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:58.632143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1341/2690] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:58 2022] DELETE /identity/v3/users/fd82b4bcb6d64e2593e23b3e29db8f0d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:10:58.766325 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:58.767771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.781949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cebf3-97c0-473b-bc5c-8a3ad82756bc service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:58.854894 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:58.855642 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:58.855956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:58.856308 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:58.858721 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:58.947941 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:58.949313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:58.960102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1350/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:10:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:10:58.993016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:59.002306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:59.092728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97afd1-1bf0-4894-b409-cae4a9c92eb6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:59.099064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:59.099970 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.100435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.100815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] PATH_INFO: `/v3/projects/4b77bb17389244ba913d938a3812e125` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.103153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b77bb17389244ba913d938a3812e125)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:59.105367 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:59.171921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b77bb17389244ba913d938a3812e125', 'request_id': 'req-1683bdc7-8e23-4928-9d19-6696b36dec9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.181982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b77bb17389244ba913d938a3812e125', 'request_id': 'req-1683bdc7-8e23-4928-9d19-6696b36dec9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.188695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b77bb17389244ba913d938a3812e125', 'request_id': 'req-1683bdc7-8e23-4928-9d19-6696b36dec9a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.199740 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] The token cache is being invalidate because project 4b77bb17389244ba913d938a3812e125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:59.199962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.200597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.205858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1342/2692] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:58 2022] DELETE /identity/v3/projects/4b77bb17389244ba913d938a3812e125 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:59.207458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:59.220267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133cde1-b6f8-4fdc-90e7-bbcbd3cd85ae service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:59.224869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:59.293830 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:59.294602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.294978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.295355 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] PATH_INFO: `/v3/users/070ae01a2105471b96958350caf91dbb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.296659 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=070ae01a2105471b96958350caf91dbb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:59.299362 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:59.351880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070ae01a2105471b96958350caf91dbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.359765 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070ae01a2105471b96958350caf91dbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.360450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070ae01a2105471b96958350caf91dbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.373186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070ae01a2105471b96958350caf91dbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.373930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b9367c32-499f-456c-bc90-82b1daa501fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070ae01a2105471b96958350caf91dbb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.387077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1351/2693] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:10:59 2022] DELETE /identity/v3/users/070ae01a2105471b96958350caf91dbb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:59.664469 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:59.666677 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:59.676277 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:59.689969 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683bdc7-8e23-4928-9d19-6696b36dec9a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:59.747550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:59.748127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.748411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.748690 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] PATH_INFO: `/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.750429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f386d2c67ba24b1381c5288ab7c2b2f7)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:59.752342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:59.799231 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f386d2c67ba24b1381c5288ab7c2b2f7', 'request_id': 'req-427ef66c-f892-47b4-bfe5-0eaef3e675eb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.806484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f386d2c67ba24b1381c5288ab7c2b2f7', 'request_id': 'req-427ef66c-f892-47b4-bfe5-0eaef3e675eb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.813207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f386d2c67ba24b1381c5288ab7c2b2f7', 'request_id': 'req-427ef66c-f892-47b4-bfe5-0eaef3e675eb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.823791 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] The token cache is being invalidate because project f386d2c67ba24b1381c5288ab7c2b2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:10:59.824079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.824723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-427ef66c-f892-47b4-bfe5-0eaef3e675eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:10:59.826470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1343/2694] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:10:59 2022] DELETE /identity/v3/projects/f386d2c67ba24b1381c5288ab7c2b2f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:10:59.831085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.831377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.831716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.851805 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:59.853017 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:59.914214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1352/2695] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:59.922499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.922789 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.923071 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.943205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:10:59.944467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:10:59.952691 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1344/2696] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:10:59.956867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:10:59.966775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eede6-6fe4-45a5-8e61-5f13eb6b4e84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:10:59.971562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:10:59.972184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:10:59.972469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:10:59.972773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:10:59.973514 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:10:59.973851 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:10:59.975448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:10:59.987605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1353/2697] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:10:59.991832 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.001805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cf127-d9f7-4d64-9ac6-924866ad631c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.006370 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.006979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.007261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.007534 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.008207 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.010135 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.036537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1345/2698] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:10:59 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:00.040667 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.051343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4243-d21e-41f8-be01-e553ff7a88ad admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.060312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:00.108959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.109609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.109920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.110167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.110840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.112748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.133516 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1354/2699] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:00 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:00.137608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.148658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecb62-e641-484b-b8ef-2c83b5bb85a2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.153807 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.154430 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.154714 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.154990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.156177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.158310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.168825 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1346/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:00.173479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.183933 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b211-3ff8-4b4d-a9db-1e125d6ee6a2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.189470 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.190088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.190373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.190655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.191376 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.192997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7763f-2fa7-416d-b873-be6c74919547 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.204340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1355/2701] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:00.209654 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.222019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784045e-38c9-4de4-9215-936eed8b5c21 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.227062 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.227742 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.228046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.228375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] PATH_INFO: `/v3/projects/56e3ebbb1e2e4f1bbb4dd6f1a9643ce4/users/c209cf3fb76c4633a0dce0a2c2305aaa/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.244821 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e3ebbb1e2e4f1bbb4dd6f1a9643ce4, user_id=c209cf3fb76c4633a0dce0a2c2305aaa, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.247617 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.262165 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1347/2702] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:00 2022] PUT /identity/v3/projects/56e3ebbb1e2e4f1bbb4dd6f1a9643ce4/users/c209cf3fb76c4633a0dce0a2c2305aaa/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:00.274214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.274502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.274780 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.304307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] MFA Rules not processed for user `c209cf3fb76c4633a0dce0a2c2305aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:00.305573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:00.370929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1356/2703] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:00.383238 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.385292 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:00.426257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:00.455396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1dc5-a981-4086-bf2d-37acc39e19ec admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.459550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.460169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.460495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.460779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.470256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.471694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed11fe1-d9c9-44c8-bfbe-4df418416a2b service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.481278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1348/2704] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:00.508272 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.582204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150b4df-dfb7-4d73-9741-ebf1b16bd218 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.586821 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.587464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.587746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.588022 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] PATH_INFO: `/v3/users/c209cf3fb76c4633a0dce0a2c2305aaa` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.589192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c209cf3fb76c4633a0dce0a2c2305aaa)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.591124 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.613651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:00.639519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c209cf3fb76c4633a0dce0a2c2305aaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:00.646620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c209cf3fb76c4633a0dce0a2c2305aaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:00.647330 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c209cf3fb76c4633a0dce0a2c2305aaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:00.660685 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c209cf3fb76c4633a0dce0a2c2305aaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:00.661442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c209cf3fb76c4633a0dce0a2c2305aaa'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:00.675611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1357/2705] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:00 2022] DELETE /identity/v3/users/c209cf3fb76c4633a0dce0a2c2305aaa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:00.680234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.680698 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.680795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.700271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:00.701490 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:00.762760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1349/2706] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:00.772369 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:00.773841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:00.832304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438c51-5906-42f2-9de4-1a916c678d7e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:00.835981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:00.836605 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:00.836889 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:00.837168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:00.846133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:00.847556 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c87e6-1a97-4c0a-aa1c-7941df5bec3c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:00.857085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1358/2707] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:01.125177 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.126635 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:01.143193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fa0fe-3cfb-4131-aeed-81858ebd8333 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.148186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.148884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.149107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.149422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] PATH_INFO: `/v3/projects/56e3ebbb1e2e4f1bbb4dd6f1a9643ce4` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.150741 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e3ebbb1e2e4f1bbb4dd6f1a9643ce4)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.152933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.199548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e3ebbb1e2e4f1bbb4dd6f1a9643ce4', 'request_id': 'req-d6b681bd-f9b3-4d6b-ba72-e212b8765197'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:01.207121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e3ebbb1e2e4f1bbb4dd6f1a9643ce4', 'request_id': 'req-d6b681bd-f9b3-4d6b-ba72-e212b8765197'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:01.213539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e3ebbb1e2e4f1bbb4dd6f1a9643ce4', 'request_id': 'req-d6b681bd-f9b3-4d6b-ba72-e212b8765197'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:01.224282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] The token cache is being invalidate because project 56e3ebbb1e2e4f1bbb4dd6f1a9643ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:01.224569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:01.225200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d6b681bd-f9b3-4d6b-ba72-e212b8765197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:01.226892 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1350/2708] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:01 2022] DELETE /identity/v3/projects/56e3ebbb1e2e4f1bbb4dd6f1a9643ce4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:01.231740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.232243 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.232341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.253442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:01.254796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:01.319015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1359/2709] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:01.326653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.326979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.327260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.346750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:01.348048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:01.356454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1351/2710] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:01.361074 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.372055 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32b8a4-e1f7-41c3-b8cd-fd1375697cf9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.378051 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.378684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.378966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.379245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.379943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:01.380254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.381877 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.398624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1360/2711] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:11:01.399852 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.409465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869dd0-b3a0-4973-922a-9f7172631190 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.414217 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.414831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.415111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.415389 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.416080 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.418368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.445890 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1352/2712] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:01 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:01.450167 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.460235 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91204908-4006-474c-927c-4bceabc196e2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.490757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:01.521526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.522150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.522554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.522839 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.523714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.526420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.549226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1361/2713] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:01 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:01.553604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.564864 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0501aba-2aec-4581-abdc-c6c9b5364169 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.569600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.570210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.570495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.570767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.571454 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.573223 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.583590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1353/2714] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:01.591351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.602007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbab1d-becb-4a2b-97f1-8965c1c16343 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.607048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.607786 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.608661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.608959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.609814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.611398 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2608d-8a20-47e5-abfa-477e6ca946df admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.622811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1362/2715] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:01.627911 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.637931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac37def-5ece-47fa-bd44-9565dcba7523 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.642634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.643294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.643577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.643856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] PATH_INFO: `/v3/projects/07e66c36b7464231a659f6e5a013000c/users/65cf9a0cb0eb421298a3b5e4ab460584/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.661007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e66c36b7464231a659f6e5a013000c, user_id=65cf9a0cb0eb421298a3b5e4ab460584, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.664600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.668048 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:01.684902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1354/2716] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:01 2022] PUT /identity/v3/projects/07e66c36b7464231a659f6e5a013000c/users/65cf9a0cb0eb421298a3b5e4ab460584/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:01.698604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.698604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.698604 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.727133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] MFA Rules not processed for user `65cf9a0cb0eb421298a3b5e4ab460584`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:01.728844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:01.798222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1363/2717] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:01.809571 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:01.812189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:01.873142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a01f-6e95-4dfc-9731-372496653740 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:01.877634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:01.878258 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:01.878541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:01.878819 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:01.894447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:01.895896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72a7d7-c8c3-4d97-888c-e3a212104e77 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:01.905491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1355/2718] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:02.438246 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:02.439652 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:02.506859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a986f-7661-42ac-bb50-6cdd26e98eb0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:02.511442 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:02.512084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:02.512371 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:02.512649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] PATH_INFO: `/v3/users/e7485faea40446989f03a585cca70425` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:02.513841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7485faea40446989f03a585cca70425)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:02.516497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:02.555945 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:02.562226 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7485faea40446989f03a585cca70425'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:02.570991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7485faea40446989f03a585cca70425'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:02.571513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7485faea40446989f03a585cca70425'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:02.584468 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7485faea40446989f03a585cca70425'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:02.585097 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7485faea40446989f03a585cca70425'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:02.597253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1364/2719] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:02 2022] DELETE /identity/v3/users/e7485faea40446989f03a585cca70425 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:02.602211 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:02.602538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:02.602817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:02.621434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:02.622634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:02.681612 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1356/2720] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:02.691865 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:02.693287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:02.750264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc1e00-127d-427f-8865-1fde62c0027b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:02.754063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:02.754684 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:02.754975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:02.755254 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:02.765026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:02.766550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18a51-985d-47b6-9e83-33858e95bbb8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:02.775968 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1365/2721] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:11:03.047326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.049063 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:03.063336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf821-24bd-4037-96d5-f089c951252e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.068055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.068702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.068982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.069256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] PATH_INFO: `/v3/projects/a939bcba6b2641fe8d90c6ae4feadb4f` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.070531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a939bcba6b2641fe8d90c6ae4feadb4f)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.072450 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.123460 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a939bcba6b2641fe8d90c6ae4feadb4f', 'request_id': 'req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:03.131628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a939bcba6b2641fe8d90c6ae4feadb4f', 'request_id': 'req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:03.138396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a939bcba6b2641fe8d90c6ae4feadb4f', 'request_id': 'req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:03.150477 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] The token cache is being invalidate because project a939bcba6b2641fe8d90c6ae4feadb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:03.150770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:03.151889 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6cb03a83-3a97-4619-a7ed-16a7c5b89e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:03.154334 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1357/2722] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:03 2022] DELETE /identity/v3/projects/a939bcba6b2641fe8d90c6ae4feadb4f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:03.159571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.159867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.160150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.181746 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:03.183064 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:03.244028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1366/2723] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:03.254158 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.254556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.254906 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.276001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:03.277256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:03.286966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1358/2724] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:03.290890 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.302236 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727de03a-c1d3-4da8-975d-e0ea600a457d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.307715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.308343 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.308631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.308915 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.309862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:03.310183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.311893 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.323844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1367/2725] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:03.328293 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.337914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510c712-a90f-4a4f-86fd-44e1516e1da0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.344208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.344872 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.345159 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.345479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.346150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.348254 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.361530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:03.387112 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1359/2726] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:03.391989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.402166 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655dbc-d5be-4f6a-8592-e830821ebb7e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.465393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:03.473297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.473903 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.474194 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.474478 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.475154 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.477100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.502158 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1368/2727] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:03.506218 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.517213 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d7012-096f-44f0-b525-9849db698989 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.521936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.522548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.522829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.523101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.523794 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.525496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.535981 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1360/2728] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:03.539963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.551192 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a7bd2-c4b9-4ebe-a84f-02a28c114b83 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.556653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.557351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.557675 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.558026 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.558768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.560601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc004f-029e-487e-a1e3-8dd062be1494 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.572112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1369/2729] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:03.576344 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.586692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb64f04-6c1b-46c2-8287-fb85d0d7d442 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.591680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.592384 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.592686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.592949 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] PATH_INFO: `/v3/projects/5a750f25f50c4ba1a4b2d3e6793524a8/users/581b85cee5af4d7982c720929c43dbb0/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.609210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a750f25f50c4ba1a4b2d3e6793524a8, user_id=581b85cee5af4d7982c720929c43dbb0, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.612755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.626012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1361/2730] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:03 2022] PUT /identity/v3/projects/5a750f25f50c4ba1a4b2d3e6793524a8/users/581b85cee5af4d7982c720929c43dbb0/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:03.636601 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.636901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.637176 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.665152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] MFA Rules not processed for user `581b85cee5af4d7982c720929c43dbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:03.666633 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:03.729394 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1370/2731] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:03.734297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.794910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008d21-6257-4b13-aedf-ca1f2e3e886f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.800616 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.801240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.801556 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.801834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.802491 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.804391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.830987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1362/2732] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:03.835112 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.846020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3a8ef-267c-4e86-a145-f39632de39d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.902752 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.903372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.903660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.903940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.904603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.907282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.928836 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1371/2733] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:03 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:03.932796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.942989 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6227-d763-473a-a4e7-d781c8f3075a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.947540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.948139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.948416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.948686 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.949422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:03.951010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:03.961405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1363/2734] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:03.965592 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:03.976544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcd760-b741-402e-9092-56cb4b055a51 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:03.981373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:03.981994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:03.982294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:03.982561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] PATH_INFO: `/v3/projects/39bd9140739c495c8f84cf8fe92ed996/users/baf6e662a75a4a52a52b2eb06320c6bb/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:03.997869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bd9140739c495c8f84cf8fe92ed996, user_id=baf6e662a75a4a52a52b2eb06320c6bb, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.000520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.013391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1372/2735] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:03 2022] PUT /identity/v3/projects/39bd9140739c495c8f84cf8fe92ed996/users/baf6e662a75a4a52a52b2eb06320c6bb/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:04.017494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.027875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319680d2-5011-4700-852b-4a205d1bb799 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.083244 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.083849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.084118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.084391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.085069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.086682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b278e-2a7f-4d52-921f-5f61da59a326 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.096750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1364/2736] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:04.100860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.111960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ea3d-4151-4e9f-92da-4230ab7f94a0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.116773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.117473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.117762 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.118045 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] PATH_INFO: `/v3/projects/39bd9140739c495c8f84cf8fe92ed996/users/baf6e662a75a4a52a52b2eb06320c6bb/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.120028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bd9140739c495c8f84cf8fe92ed996, user_id=baf6e662a75a4a52a52b2eb06320c6bb, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.122717 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.133069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1373/2737] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:04 2022] PUT /identity/v3/projects/39bd9140739c495c8f84cf8fe92ed996/users/baf6e662a75a4a52a52b2eb06320c6bb/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:04.143407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.143693 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.143967 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.172723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] MFA Rules not processed for user `baf6e662a75a4a52a52b2eb06320c6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:04.174011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:04.187551 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:04.248438 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1365/2738] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:04.260053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.261920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:04.273248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:04.324564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52c1b4-e7d2-4c4e-98e4-cceed281c4a5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.328895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.329550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.329842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.330121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.338604 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.340115 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:04.341115 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.343643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.353453 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1374/2739] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:04.409908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9542f-98bc-4c4d-b6fa-feedd40de41c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.415297 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.415953 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.416241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.416523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] PATH_INFO: `/v3/users/13779d9a406940e5a89ef404207225bc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.417735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13779d9a406940e5a89ef404207225bc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.419657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.432711 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.442028 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b3564-ee52-4f39-9437-7e87e5fb33df service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.446189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.446812 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.447096 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.447421 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.470092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13779d9a406940e5a89ef404207225bc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:04.480395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13779d9a406940e5a89ef404207225bc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:04.481559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13779d9a406940e5a89ef404207225bc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:04.482192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13779d9a406940e5a89ef404207225bc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:04.496405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-696b6f41-c77e-4010-bfbe-42f786916fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13779d9a406940e5a89ef404207225bc'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:04.512407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1366/2740] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:04 2022] DELETE /identity/v3/users/13779d9a406940e5a89ef404207225bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:04.517628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.517920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.518206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.522697 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.524140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.540515 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:04.541837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:04.542651 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1375/2741] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:11:04.568972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:04.611046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1367/2742] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:04.622005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:04.624734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:04.706495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bea0ad-0a19-404a-8d30-dfd04707ab53 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:04.760238 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:04.760770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:04.761047 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:04.761357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:04.771273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:04.772691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:04.782654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1376/2743] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:05.053395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:05.054795 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:05.067532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746e33-146d-4ffd-b408-7ed07e846d73 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:05.072333 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:05.073102 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.073441 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.073718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] PATH_INFO: `/v3/projects/35543a695fd74544a4d9ae02db2f8e2c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.074887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35543a695fd74544a4d9ae02db2f8e2c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:05.076958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:05.122381 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35543a695fd74544a4d9ae02db2f8e2c', 'request_id': 'req-35726ef2-ffc2-4301-978e-a99966f1c34a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.130433 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35543a695fd74544a4d9ae02db2f8e2c', 'request_id': 'req-35726ef2-ffc2-4301-978e-a99966f1c34a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.136540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35543a695fd74544a4d9ae02db2f8e2c', 'request_id': 'req-35726ef2-ffc2-4301-978e-a99966f1c34a'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.147125 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] The token cache is being invalidate because project 35543a695fd74544a4d9ae02db2f8e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:05.147418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.148084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.149652 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1368/2744] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:05 2022] DELETE /identity/v3/projects/35543a695fd74544a4d9ae02db2f8e2c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:05.153847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:05.163823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fe64-0316-49a7-b226-46985708c681 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:05.168472 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:05.219713 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:05.220345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.220625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.220899 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] PATH_INFO: `/v3/users/25b58c41c69a4ecab7ee9d22a488c89b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.222069 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b58c41c69a4ecab7ee9d22a488c89b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:05.223975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:05.267952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b58c41c69a4ecab7ee9d22a488c89b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.274960 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b58c41c69a4ecab7ee9d22a488c89b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.275571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b58c41c69a4ecab7ee9d22a488c89b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.287818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b58c41c69a4ecab7ee9d22a488c89b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.288492 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c9767619-9894-4717-b493-4ae67e1bb02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b58c41c69a4ecab7ee9d22a488c89b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.301429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1377/2745] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:05 2022] DELETE /identity/v3/users/25b58c41c69a4ecab7ee9d22a488c89b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:05.573155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:05.574653 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:05.589132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726ef2-ffc2-4301-978e-a99966f1c34a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:05.647530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:05.648180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.648459 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.648734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] PATH_INFO: `/v3/projects/2ac6048992854e87aecb00c23fee7b1b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.649943 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac6048992854e87aecb00c23fee7b1b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:05.652138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:05.699978 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac6048992854e87aecb00c23fee7b1b', 'request_id': 'req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.707810 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac6048992854e87aecb00c23fee7b1b', 'request_id': 'req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.709361 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:05.716546 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac6048992854e87aecb00c23fee7b1b', 'request_id': 'req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.730594 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] The token cache is being invalidate because project 2ac6048992854e87aecb00c23fee7b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:05.730883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.731692 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-0c7e1b30-f37e-41ae-a086-c34b18a8eb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:05.734151 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1369/2746] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:05 2022] DELETE /identity/v3/projects/2ac6048992854e87aecb00c23fee7b1b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:05.739225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.740596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.740744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.760666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:05.761911 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:05.841322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1378/2747] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:05.850476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.850768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.851051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.876201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:05.877873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:05.889668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1370/2748] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:05.891553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:05.904007 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a86b2-9f2e-4e6b-90c9-3280c33df305 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:05.911974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:05.917480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:05.928563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1379/2749] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:05.935152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:05.945533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1f75f-5ab7-4b57-9e12-1e4fd7cbf0b5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:05.950498 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:05.951198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:05.951483 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:05.952368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:05.953055 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:05.955699 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:05.990041 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1371/2750] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:05 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:05.991520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:06.002237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23940c0f-2844-459b-8dec-13f62532a6e8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:06.015723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:06.068602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:06.069242 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.069572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.069856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.070531 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:06.073061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:06.100620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1380/2751] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:05 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:06.102348 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:06.113632 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8d02-a86d-4c49-babe-668a3161aeae admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:06.118278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:06.118888 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.119171 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.119445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.120142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:06.121790 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:06.133299 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1372/2752] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:06.137168 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:06.148439 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be41c1-4c5a-4d12-88b5-e66762afb992 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:06.153650 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:06.154324 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.154551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.154917 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.156779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:06.158419 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e81756-9165-4186-b502-f3359ac57bfa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:06.173165 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1381/2753] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:06.177780 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:06.188771 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590707-a74a-4082-b165-a8e2ce8f053e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:06.194849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:06.195437 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.195717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.196123 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] PATH_INFO: `/v3/projects/df203a82310d4dcda03d096b8f13207a/users/5c29e332134c4727a3254d43dd3bb7c3/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.213462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df203a82310d4dcda03d096b8f13207a, user_id=5c29e332134c4727a3254d43dd3bb7c3, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:06.216153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:06.229918 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1373/2754] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:06 2022] PUT /identity/v3/projects/df203a82310d4dcda03d096b8f13207a/users/5c29e332134c4727a3254d43dd3bb7c3/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:06.235215 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874395-49eb-426c-9b61-cc3b9db92b5c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.235512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874395-49eb-426c-9b61-cc3b9db92b5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.235797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de874395-49eb-426c-9b61-cc3b9db92b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.254840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-de874395-49eb-426c-9b61-cc3b9db92b5c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:06.256046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-de874395-49eb-426c-9b61-cc3b9db92b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:06.316011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1382/2755] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:06.325746 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:06.328110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:06.384798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f8cb-32da-4315-aeb3-abac8760ba03 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:06.388336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:06.388947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:06.389813 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:06.390108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:06.398904 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:06.400314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:06.409932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1374/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:10.849580 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:10.850114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:10.850114 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:10.890464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] MFA Rules not processed for user `5c29e332134c4727a3254d43dd3bb7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:10.891936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:10.986549 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1383/2757] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:10.990831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.001043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465cb7-3cda-4fc1-8a87-665bf1b52dda service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.005779 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.006401 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.006688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.006965 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.007643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.009753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.040610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1375/2758] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:11.044678 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.060080 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e4e78-5f76-4bf6-a2d9-ba5cf7b6ae51 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.080603 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.082932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:11.083416 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:11.125063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.125761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.126058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.126341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.127123 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.129046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.152240 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1384/2759] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:11 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:11.156789 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.160142 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1e4a-7db5-40a6-882b-7173a4123f67 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.166484 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.166902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085640-a3aa-4f4f-8689-1f6b8e910dfb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.167139 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.167425 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.167704 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] PATH_INFO: `/v3/users/581b85cee5af4d7982c720929c43dbb0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.169127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581b85cee5af4d7982c720929c43dbb0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.172575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.172744 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.173250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.173581 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.173864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.174571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.176304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.177496 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:11.196715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1385/2760] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:11.201429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.215483 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604b51-d246-418c-bfc9-511cadde5119 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.221620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.222503 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.222793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.223077 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] PATH_INFO: `/v3/projects/cb02f44fae4e4652912f06e965a5b5dc/users/7a96da5d9d864f2c85dab0ce32ae70a5/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.242434 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb02f44fae4e4652912f06e965a5b5dc, user_id=7a96da5d9d864f2c85dab0ce32ae70a5, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.245222 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.246289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581b85cee5af4d7982c720929c43dbb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:11.254745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581b85cee5af4d7982c720929c43dbb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:11.255422 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581b85cee5af4d7982c720929c43dbb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:11.256084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581b85cee5af4d7982c720929c43dbb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:11.259033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1386/2761] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:11 2022] PUT /identity/v3/projects/cb02f44fae4e4652912f06e965a5b5dc/users/7a96da5d9d864f2c85dab0ce32ae70a5/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:11.263120 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.264819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:11.268577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-7b8d2c22-2100-4cb3-8965-e925b166e8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581b85cee5af4d7982c720929c43dbb0'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:11.282508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1376/2762] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:11 2022] DELETE /identity/v3/users/581b85cee5af4d7982c720929c43dbb0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:11.287343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.287637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.287916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.307826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:11.309034 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:11.328655 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370121-10d6-4905-b382-713c5e5a22ee admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.377921 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1377/2763] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:11.388499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.390270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:11.408339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.408729 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.409000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.409245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.410181 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.414317 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.429015 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1387/2764] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:11.430391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:11.444414 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f1dd-6cde-491b-b3f8-bf12259cb442 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.450227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.450981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.451383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.451734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] PATH_INFO: `/v3/projects/cb02f44fae4e4652912f06e965a5b5dc/users/7a96da5d9d864f2c85dab0ce32ae70a5/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.454312 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb02f44fae4e4652912f06e965a5b5dc, user_id=7a96da5d9d864f2c85dab0ce32ae70a5, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.457145 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.466257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a4d0-ef6f-45fb-876d-ba963ea8061d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:11.469567 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1388/2765] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:11 2022] PUT /identity/v3/projects/cb02f44fae4e4652912f06e965a5b5dc/users/7a96da5d9d864f2c85dab0ce32ae70a5/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:11.507479 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:11.526531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:11.527160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:11.527471 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:11.527750 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:11.592399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:11.593927 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:11.604676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1378/2766] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:12.088195 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:12.090018 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:12.107264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0b88-8275-4776-bff4-51ffb6a2ce08 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:12.112544 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:12.113253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:12.113627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:12.114005 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] PATH_INFO: `/v3/projects/5a750f25f50c4ba1a4b2d3e6793524a8` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:12.115358 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a750f25f50c4ba1a4b2d3e6793524a8)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:12.117471 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:12.120540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:12.199117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a750f25f50c4ba1a4b2d3e6793524a8', 'request_id': 'req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.210196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a750f25f50c4ba1a4b2d3e6793524a8', 'request_id': 'req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.225011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a750f25f50c4ba1a4b2d3e6793524a8', 'request_id': 'req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.261479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] The token cache is being invalidate because project 5a750f25f50c4ba1a4b2d3e6793524a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:12.261822 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.262550 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.264485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1389/2767] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:12 2022] DELETE /identity/v3/projects/5a750f25f50c4ba1a4b2d3e6793524a8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:12.269658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:12.282817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299a701-3a1e-4cb5-873b-9b2d9f892285 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:12.350391 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:12.351131 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:12.351507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:12.351914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] PATH_INFO: `/v3/users/baf6e662a75a4a52a52b2eb06320c6bb` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:12.353174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf6e662a75a4a52a52b2eb06320c6bb)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:12.355241 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:12.412289 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf6e662a75a4a52a52b2eb06320c6bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.420308 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf6e662a75a4a52a52b2eb06320c6bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.421110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf6e662a75a4a52a52b2eb06320c6bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.421858 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf6e662a75a4a52a52b2eb06320c6bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.437091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d89f1df4-c1f1-44f0-83b1-325411409568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf6e662a75a4a52a52b2eb06320c6bb'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.455992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1379/2768] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:12 2022] DELETE /identity/v3/users/baf6e662a75a4a52a52b2eb06320c6bb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:12.490134 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:12.492321 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:12.511189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986bb8a-4f9f-4a39-ab7c-242112cbb87b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:12.588639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:12.589563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:12.589956 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:12.590507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] PATH_INFO: `/v3/users/65cf9a0cb0eb421298a3b5e4ab460584` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:12.593067 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cf9a0cb0eb421298a3b5e4ab460584)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:12.596000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:12.670632 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cf9a0cb0eb421298a3b5e4ab460584'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.685307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cf9a0cb0eb421298a3b5e4ab460584'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.685891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cf9a0cb0eb421298a3b5e4ab460584'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.707388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cf9a0cb0eb421298a3b5e4ab460584'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.711879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cf9a0cb0eb421298a3b5e4ab460584'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:12.735768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1390/2769] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:12 2022] DELETE /identity/v3/users/65cf9a0cb0eb421298a3b5e4ab460584 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:12.736951 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:12.737252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:12.737550 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:12.760793 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:12.767856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:12.773076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:12.811617 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:12.813204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:12.845819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:12.913309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1380/2770] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:12.926149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:12.927323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e5340-22fa-46a2-9180-2bc6d900b598 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:12.927695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:12.932383 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:12.933033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:12.933339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:12.933620 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] PATH_INFO: `/v3/projects/39bd9140739c495c8f84cf8fe92ed996` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:12.934860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39bd9140739c495c8f84cf8fe92ed996)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:12.937643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.032974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39bd9140739c495c8f84cf8fe92ed996', 'request_id': 'req-15b23661-e0e6-4ef2-89ef-225d05a87a4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:13.035796 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040d0b-9cbf-4955-82cd-1f760a70e8b9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.044041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39bd9140739c495c8f84cf8fe92ed996', 'request_id': 'req-15b23661-e0e6-4ef2-89ef-225d05a87a4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:13.054454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39bd9140739c495c8f84cf8fe92ed996', 'request_id': 'req-15b23661-e0e6-4ef2-89ef-225d05a87a4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:13.069237 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] The token cache is being invalidate because project 39bd9140739c495c8f84cf8fe92ed996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:13.069715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:13.070898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-15b23661-e0e6-4ef2-89ef-225d05a87a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:13.076448 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1391/2771] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:12 2022] DELETE /identity/v3/projects/39bd9140739c495c8f84cf8fe92ed996 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:13.078796 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.079668 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.080060 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.107001 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.108195 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.108497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.108753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.111285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:13.115256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:13.117564 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:13.199114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.200614 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01868d95-7829-400e-9112-bf07f7e4ddf3 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.212110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1381/2772] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:11:13.216227 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1392/2773] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:13.226044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.226583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.226935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.261015 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:13.262467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:13.271676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1382/2774] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:13.276178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.287139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ab11-98ac-48ee-8381-a1b28794624a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.292310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.292803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.293133 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.293420 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.294198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:13.294482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.298881 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.323507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1393/2775] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:13.328851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.340280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77824-442a-4443-bece-1ba1145e75c0 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.346232 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.346707 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.347089 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.347512 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.348393 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.350545 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.355465 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:13.388081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1383/2776] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:13.389959 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.400157 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f517c-82cf-47c2-9007-02278f3c45dd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.436873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:13.508487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.509672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.510548 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.511030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.511898 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.514727 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.551807 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1394/2777] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:13.556099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.566837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9106b-0e70-4086-9b4f-8cc02eb3b58d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.572434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.573356 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.573938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.574374 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.575302 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.577815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.596739 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1384/2778] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:13.600465 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.611495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabce13-8fc7-4433-b1a6-45f15b88762c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.622562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.624140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.624527 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.624995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.625860 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.627809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ef99b-99f3-47c0-9369-b63017078eaa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.646052 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1395/2779] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:13.650586 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:13.664108 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53e745-c71a-4676-a424-b58c3c5f111f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:13.671368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:13.672420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.673052 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.673478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] PATH_INFO: `/v3/projects/a3dea38ee6404004bce820912a47d956/users/6c8225f335f248758d1eb42000189524/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.698720 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3dea38ee6404004bce820912a47d956, user_id=6c8225f335f248758d1eb42000189524, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:13.702657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:13.727234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1385/2780] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:13 2022] PUT /identity/v3/projects/a3dea38ee6404004bce820912a47d956/users/6c8225f335f248758d1eb42000189524/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:13.739008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:13.739457 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:13.739603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:13.777409 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] MFA Rules not processed for user `6c8225f335f248758d1eb42000189524`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:13.779032 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:13.873561 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1396/2781] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:13.878153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.002701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca6b6-31ba-445f-b0f9-cdc9ca89573f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.014026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.014915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.015280 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.015630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.016394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.018485 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.072470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1386/2782] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:13 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:14.073795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.093116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce97e1-f266-4fb7-b76a-d3106c39af67 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.214996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.220445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:14.285078 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.288035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.288035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.288035 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.293673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.295784 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.339488 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1397/2783] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:14 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:14.341177 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.366430 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ddf9-67d7-422d-83f8-41903966e2b9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.380554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.381331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.381623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.381906 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.382606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.384395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.390470 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99619ca7-05fb-4657-8ad9-9dc82228cfd5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.405402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1398/2784] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:14.406098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.406765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.407257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.407489 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] PATH_INFO: `/v3/projects/07e66c36b7464231a659f6e5a013000c` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.408921 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.410040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e66c36b7464231a659f6e5a013000c)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.412952 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.423801 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0256b-b73c-490e-be66-478ec30e538c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.429033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.429773 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.430062 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.430345 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.431108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.432745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.444413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1399/2785] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:14.449793 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.460852 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:14.465884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f30af-61ba-4dff-9911-6f4674e37c07 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:14.474392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:14.475250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.475639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.476557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] PATH_INFO: `/v3/projects/d58cb86192204e389e1a5de7bb6bdc72/users/ca11aa95199749b38856152f593482aa/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.496753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58cb86192204e389e1a5de7bb6bdc72, user_id=ca11aa95199749b38856152f593482aa, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:14.500646 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cd640-3140-4fa7-a7ab-de4ef75a3866 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:14.501160 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:14.525313 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1400/2786] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:14 2022] PUT /identity/v3/projects/d58cb86192204e389e1a5de7bb6bdc72/users/ca11aa95199749b38856152f593482aa/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:14.529487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e66c36b7464231a659f6e5a013000c', 'request_id': 'req-6055209a-bbfa-4bec-adcc-814682b0624c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:14.533197 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:14.533723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:14.534111 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:14.550445 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e66c36b7464231a659f6e5a013000c', 'request_id': 'req-6055209a-bbfa-4bec-adcc-814682b0624c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:14.566342 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e66c36b7464231a659f6e5a013000c', 'request_id': 'req-6055209a-bbfa-4bec-adcc-814682b0624c'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:14.582081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] MFA Rules not processed for user `ca11aa95199749b38856152f593482aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:14.584699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:14.590268 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] The token cache is being invalidate because project 07e66c36b7464231a659f6e5a013000c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:14.590572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:14.594395 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:14.599527 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1387/2787] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:14 2022] DELETE /identity/v3/projects/07e66c36b7464231a659f6e5a013000c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:14.760832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1401/2788] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:14.767525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:14.769595 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:14.988620 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055209a-bbfa-4bec-adcc-814682b0624c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.090182 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.090987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.091447 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.092524 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.094278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.099873 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.173938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1388/2789] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:14 2022] POST /identity/v3/projects => generated 387 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:15.175129 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.194220 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be227057-c39a-44d3-9a48-54afd6c713fc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.285833 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.286631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.287056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.287573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.288373 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.290515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.328799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1402/2790] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:15 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:15.332541 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.349734 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94eb6-9784-4a75-b95d-d8f9807f8291 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.356815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.358157 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.358521 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.358874 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.359664 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.361434 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.376713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1389/2791] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:15.378081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.390334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204787e-8195-48a7-9bbc-ec36c1b216b1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.396575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.397090 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.397480 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.397835 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] PATH_INFO: `/v3/projects/f195e22ec9e64ebabb128190b544cff8/users/77d89d6863fe4b3e896d1df1fea942df/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.420121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f195e22ec9e64ebabb128190b544cff8, user_id=77d89d6863fe4b3e896d1df1fea942df, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.424009 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.443214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1403/2792] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:15 2022] PUT /identity/v3/projects/f195e22ec9e64ebabb128190b544cff8/users/77d89d6863fe4b3e896d1df1fea942df/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:15.447155 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.469239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64880532-212f-4be5-8e25-6ed81d70157d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.525036 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:15.550669 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.551322 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.551608 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.551882 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.553114 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.554304 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee028-7ec3-41cf-81a4-c0cb9fab2218 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.573309 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1390/2793] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:15.577596 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.591405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974dbae-bd12-4e90-916a-9f369870a91b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:15.597873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:15.598571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.598861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.599143 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] PATH_INFO: `/v3/projects/f195e22ec9e64ebabb128190b544cff8/users/77d89d6863fe4b3e896d1df1fea942df/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.605103 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f195e22ec9e64ebabb128190b544cff8, user_id=77d89d6863fe4b3e896d1df1fea942df, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:15.608286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:15.630498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1404/2794] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:15 2022] PUT /identity/v3/projects/f195e22ec9e64ebabb128190b544cff8/users/77d89d6863fe4b3e896d1df1fea942df/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:15.641067 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:15.641762 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:15.642221 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:15.726415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] MFA Rules not processed for user `77d89d6863fe4b3e896d1df1fea942df`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:15.727896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:15.916640 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1391/2795] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:15.929816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:15.931949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:15.990428 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:16.075322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0648a2e-cafb-4d80-b7a8-12163e315e14 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:16.084896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:16.089508 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:16.089951 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:16.090252 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:16.113930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:16.115413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c2d69-84df-4f1b-9a1b-66aeb66332d3 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:16.137101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1405/2796] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:16.989622 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:16.992099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:17.020278 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563826d-9981-4706-82ca-5d23341fa6da None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:17.060930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:17.061638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:17.061929 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:17.062209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:17.065190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:17.140251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:17.141760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:17.152910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1392/2797] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:17.610351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd77724-104c-4142-9af1-6185cdfe2b30 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:17.611203 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd77724-104c-4142-9af1-6185cdfe2b30 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:17.611634 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd77724-104c-4142-9af1-6185cdfe2b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:17.645140 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4bd77724-104c-4142-9af1-6185cdfe2b30 None None] MFA Rules not processed for user `7a96da5d9d864f2c85dab0ce32ae70a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:17.646966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4bd77724-104c-4142-9af1-6185cdfe2b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:17.724229 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1406/2798] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:17.736630 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:17.738210 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:17.798413 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073674-d2f0-46cd-89db-06db95622f03 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:17.802728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e0f106ea63a4aa781ad03d7583abd89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:17.803420 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:17.803711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:17.804094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:17.805785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:17.826979 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:17.867579 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:17.869061 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:17.878680 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1393/2799] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:18.009739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952a175-fa09-4680-99b9-277c30206787 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:18.010034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952a175-fa09-4680-99b9-277c30206787 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:18.010346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952a175-fa09-4680-99b9-277c30206787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:18.029599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0952a175-fa09-4680-99b9-277c30206787 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:18.030802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0952a175-fa09-4680-99b9-277c30206787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:18.086452 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1407/2800] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:18.133081 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:18.135808 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:18.212269 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7848-6f04-4194-b857-f5824c239970 service glance] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:18.218615 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:18.219252 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:18.219539 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:18.219815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:18.229137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:18.230785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:18.240730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1394/2801] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:11:21.689100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952a175-fa09-4680-99b9-277c30206787 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:21.715477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952a175-fa09-4680-99b9-277c30206787 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:21.721041 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:21.721716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:21.722000 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:21.722281 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:21.797122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:21.803001 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:21.804595 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b675-ab8c-4923-a9d8-2f2e7eb0fb2c service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:21.815867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1408/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:24.364533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:24.442820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d20dcc-0a31-4b54-b784-0995a89f8d6f service swift] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:24.449046 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:24.449709 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:24.449988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:24.450260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] PATH_INFO: `/v3/users/6c8225f335f248758d1eb42000189524` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:24.454230 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8225f335f248758d1eb42000189524)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:24.456169 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:24.512243 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8225f335f248758d1eb42000189524'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:24.517488 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:24.520912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8225f335f248758d1eb42000189524'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:24.522175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8225f335f248758d1eb42000189524'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:24.522901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8225f335f248758d1eb42000189524'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:24.537901 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8225f335f248758d1eb42000189524'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:24.554676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1395/2803] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:24 2022] DELETE /identity/v3/users/6c8225f335f248758d1eb42000189524 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:24.559284 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:24.559747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:24.559944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:24.582542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:24.584004 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:24.657869 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1409/2804] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:24.668730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:24.670701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:24.746605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c85a-4e60-4191-a046-8fcdbd19e502 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:24.750800 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:24.753560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:24.753560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:24.753560 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:24.764667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:24.766256 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:24.776761 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1396/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:25.078108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:25.080046 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:25.099479 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa22c74-7f87-40cc-a9e5-93cfb62f8055 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:25.105614 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:25.106275 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:25.106559 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:25.106861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] PATH_INFO: `/v3/projects/a3dea38ee6404004bce820912a47d956` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:25.119573 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3dea38ee6404004bce820912a47d956)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:25.122122 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:25.177310 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3dea38ee6404004bce820912a47d956', 'request_id': 'req-df1aab84-1169-4f16-80f1-b4730ad2f433'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.187589 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3dea38ee6404004bce820912a47d956', 'request_id': 'req-df1aab84-1169-4f16-80f1-b4730ad2f433'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.193935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3dea38ee6404004bce820912a47d956', 'request_id': 'req-df1aab84-1169-4f16-80f1-b4730ad2f433'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.208857 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] The token cache is being invalidate because project a3dea38ee6404004bce820912a47d956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:25.209152 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.209866 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.211637 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1410/2806] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:25 2022] DELETE /identity/v3/projects/a3dea38ee6404004bce820912a47d956 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:25.215597 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:25.226461 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260559fd-3d7e-4204-b088-c7a1b7e5aa73 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:25.302390 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:25.303200 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:25.303581 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:25.303926 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] PATH_INFO: `/v3/users/ca11aa95199749b38856152f593482aa` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:25.305184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca11aa95199749b38856152f593482aa)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:25.307193 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:25.369638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca11aa95199749b38856152f593482aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.379138 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca11aa95199749b38856152f593482aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.379962 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca11aa95199749b38856152f593482aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.380684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca11aa95199749b38856152f593482aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.407944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca11aa95199749b38856152f593482aa'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.409850 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:25.436003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1397/2807] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:25 2022] DELETE /identity/v3/users/ca11aa95199749b38856152f593482aa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:25.773618 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:25.775895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:25.809447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1aab84-1169-4f16-80f1-b4730ad2f433 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:25.877322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:25.878230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:25.878575 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:25.880766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] PATH_INFO: `/v3/projects/d58cb86192204e389e1a5de7bb6bdc72` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:25.882180 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58cb86192204e389e1a5de7bb6bdc72)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:25.884318 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:25.911507 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:25.943779 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58cb86192204e389e1a5de7bb6bdc72', 'request_id': 'req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.954034 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58cb86192204e389e1a5de7bb6bdc72', 'request_id': 'req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.959733 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58cb86192204e389e1a5de7bb6bdc72', 'request_id': 'req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.974763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] The token cache is being invalidate because project d58cb86192204e389e1a5de7bb6bdc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:25.974763 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.975798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:25.978054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1411/2808] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:25 2022] DELETE /identity/v3/projects/d58cb86192204e389e1a5de7bb6bdc72 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:25.982260 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:25.984373 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:26.007637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88a60-695c-48e9-bf68-4e1706f1f88a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:26.078307 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:26.078982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.079262 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.079537 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] PATH_INFO: `/v3/users/77d89d6863fe4b3e896d1df1fea942df` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.080724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d89d6863fe4b3e896d1df1fea942df)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:26.083340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:26.154705 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d89d6863fe4b3e896d1df1fea942df'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.164887 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d89d6863fe4b3e896d1df1fea942df'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.165756 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d89d6863fe4b3e896d1df1fea942df'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.166429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d89d6863fe4b3e896d1df1fea942df'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.180423 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-d7dc560a-e01d-4d88-aedc-6e00f93d1ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d89d6863fe4b3e896d1df1fea942df'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.202090 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1398/2809] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:25 2022] DELETE /identity/v3/users/77d89d6863fe4b3e896d1df1fea942df => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:26.539686 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:26.541221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:26.558517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9cb4e-f72d-4b31-bac2-4cc0ef640495 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:26.635148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:26.635814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.636104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.636388 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] PATH_INFO: `/v3/projects/f195e22ec9e64ebabb128190b544cff8` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.637755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f195e22ec9e64ebabb128190b544cff8)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:26.640391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:26.693665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f195e22ec9e64ebabb128190b544cff8', 'request_id': 'req-cdc93702-08c5-416c-8c77-98e979c03308'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.703739 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f195e22ec9e64ebabb128190b544cff8', 'request_id': 'req-cdc93702-08c5-416c-8c77-98e979c03308'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.715283 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f195e22ec9e64ebabb128190b544cff8', 'request_id': 'req-cdc93702-08c5-416c-8c77-98e979c03308'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.728774 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] The token cache is being invalidate because project f195e22ec9e64ebabb128190b544cff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:26.728989 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.729682 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdc93702-08c5-416c-8c77-98e979c03308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:26.731429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1412/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:26 2022] DELETE /identity/v3/projects/f195e22ec9e64ebabb128190b544cff8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:26.738848 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.739315 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.739411 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.762011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:26.763285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:26.850855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1399/2811] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:26.858803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.859311 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.859405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.882473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:26.883861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:26.892738 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1413/2812] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:26.897026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:26.908146 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa36d05-0f7f-4a01-a0b6-b7f50fc7ad08 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:26.913175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:26.913930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.914212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.914473 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.915317 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80313) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:26.915628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:26.917815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:26.925667 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:26.931666 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1400/2813] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:26.936256 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:26.946066 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688fae8-6ef9-4533-b8a3-2b585e854292 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:26.951473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:26.952086 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:26.952367 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:26.952644 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:26.953360 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:26.955458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:26.987244 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1414/2814] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:26 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:26.992405 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.003443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102e0cd-0ceb-45a8-b6d5-e59da3557dad admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.072538 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.073357 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.073683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.073958 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.074657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.079487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.105190 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1401/2815] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:26 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:27.109257 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.119888 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d213af-97dc-4805-8f70-0dfa1ea70017 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.125377 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.126053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.126329 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.126603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.127294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.128873 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.131219 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:27.144710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1415/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:27.145572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.157798 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea04dbd-0380-41e4-ae11-e966f05f9d5e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.162933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.163557 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.163842 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.164118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.164932 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.166679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49e4bd-a000-43d6-ad1e-af347886b4e0 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.179083 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1402/2817] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:27.183346 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.194487 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd0177-6e3d-434c-b65e-e8cb3e7ef4ef admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.200101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.200826 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.201116 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.201441 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] PATH_INFO: `/v3/projects/102ead245137485986316da5be8044e0/users/26bb9523c31f4b8c93c9b494e551a3c5/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.217290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=102ead245137485986316da5be8044e0, user_id=26bb9523c31f4b8c93c9b494e551a3c5, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.220033 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.242545 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1416/2818] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:27 2022] PUT /identity/v3/projects/102ead245137485986316da5be8044e0/users/26bb9523c31f4b8c93c9b494e551a3c5/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:27.255452 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf95-be95-4521-902e-cab61125c783 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.255736 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf95-be95-4521-902e-cab61125c783 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.256011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703adf95-be95-4521-902e-cab61125c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.294144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-703adf95-be95-4521-902e-cab61125c783 None None] MFA Rules not processed for user `26bb9523c31f4b8c93c9b494e551a3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:27.295966 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-703adf95-be95-4521-902e-cab61125c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:27.368755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1403/2819] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:27.371838 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.436153 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.436453 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.436731 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.442302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873c43-106c-436e-8092-f67d7a1dbc5b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.447907 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.448532 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.448817 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.449092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.449791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.452292 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.456375 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] MFA Rules not processed for user `5c29e332134c4727a3254d43dd3bb7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:27.457596 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:27.479294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1417/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:27 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:27.483323 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.517806 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1404/2821] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:27.546131 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65268d-f9ce-45e2-85ff-a377448a6c5f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.551126 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.551863 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.552155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.552437 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.553109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.555053 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.581464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1418/2822] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:27 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:27.582768 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.593657 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b441d-d6f4-4130-a7c9-75946fc42da5 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.598227 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.598844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.599124 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.599399 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.600091 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.601725 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.607830 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:27.616128 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1405/2823] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:27.617391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.628264 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3fa1e-56d5-41b4-bbc3-14a8aac2fbf8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.632974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.633723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.634008 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.634290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] PATH_INFO: `/v3/projects/5822975d15354f32a166d1e71f11c368/users/612c8606406f465fa2601829fabbc8d1/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.649705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5822975d15354f32a166d1e71f11c368, user_id=612c8606406f465fa2601829fabbc8d1, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.652639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.666716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1419/2824] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:27 2022] PUT /identity/v3/projects/5822975d15354f32a166d1e71f11c368/users/612c8606406f465fa2601829fabbc8d1/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:27.671787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.681945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be96f2-e647-4675-9aea-46e0ee34fa40 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.739406 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.740100 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.740294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.740570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.741346 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.742885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209b97c-2693-49a6-926e-fdc8f32fd406 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.753563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1406/2825] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:27.757783 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.768405 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601089-ce50-4dcd-bf64-243fae11fb82 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.772970 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.773782 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.774128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.774469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] PATH_INFO: `/v3/projects/5822975d15354f32a166d1e71f11c368/users/612c8606406f465fa2601829fabbc8d1/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.776756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5822975d15354f32a166d1e71f11c368, user_id=612c8606406f465fa2601829fabbc8d1, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.779493 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:27.792850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1420/2826] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:27 2022] PUT /identity/v3/projects/5822975d15354f32a166d1e71f11c368/users/612c8606406f465fa2601829fabbc8d1/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:27.801137 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.801467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.801753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.830544 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] MFA Rules not processed for user `612c8606406f465fa2601829fabbc8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:27.831891 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:27.903118 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1407/2827] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:27.915027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:27.916816 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:27.931734 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:27.978202 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1d953-9b0c-47ce-a708-844bbeb3750e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:27.981901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:27.982520 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:27.982819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:27.983087 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:27.992415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:27.993887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf39d0-c752-48a2-861a-85367a3b4735 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:28.004354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1421/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:28.081728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:28.101880 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d559101-7ef6-4a38-aee7-0e345f59df87 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:28.105875 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:28.106526 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:28.107396 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:28.107711 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:28.182435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:28.184026 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:28.193014 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1408/2829] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:29.346014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:29.346512 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:29.346615 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:29.366011 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:29.367230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:29.432006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1422/2830] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 20:11:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:29.445733 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:29.447130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:29.469786 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:29.522353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043504fe-4218-4c98-8d68-e93424864391 service cinder] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:29.529783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:29.530500 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:29.530856 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:29.531202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:29.543841 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:29.546285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37bb72-ad37-43f3-a8f1-fcc58019e891 service swift] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:29.564044 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1409/2831] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:11:32.447557 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:32.520875 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c479569-c6e1-4511-8a07-b029bba4b7e8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:32.526059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:32.526818 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:32.527104 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:32.527386 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] PATH_INFO: `/v3/users/26bb9523c31f4b8c93c9b494e551a3c5` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:32.528571 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bb9523c31f4b8c93c9b494e551a3c5)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:32.530919 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:32.586691 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bb9523c31f4b8c93c9b494e551a3c5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:32.595402 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bb9523c31f4b8c93c9b494e551a3c5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:32.596063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bb9523c31f4b8c93c9b494e551a3c5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:32.601464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:32.610887 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bb9523c31f4b8c93c9b494e551a3c5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:32.611884 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bb9523c31f4b8c93c9b494e551a3c5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:32.625233 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1423/2832] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:32 2022] DELETE /identity/v3/users/26bb9523c31f4b8c93c9b494e551a3c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:32.629513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:32.629975 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:32.630074 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:32.652871 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:32.654648 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:32.730659 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1410/2833] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:32.741619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:32.743335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:32.850714 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdbe4a-af9e-4a0a-ae5b-d0f90e93a842 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:32.854700 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:32.855413 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:32.861287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:32.861287 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:32.868760 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:32.870502 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:32.890432 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1424/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:33.222064 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:33.223542 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:33.245236 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e623-8ae7-4c77-83c6-e6a44cfc556d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:33.251896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:33.252572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:33.252855 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:33.253184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] PATH_INFO: `/v3/projects/102ead245137485986316da5be8044e0` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:33.258529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102ead245137485986316da5be8044e0)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:33.258529 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:33.308276 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102ead245137485986316da5be8044e0', 'request_id': 'req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.321173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102ead245137485986316da5be8044e0', 'request_id': 'req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.331147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102ead245137485986316da5be8044e0', 'request_id': 'req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.343176 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] The token cache is being invalidate because project 102ead245137485986316da5be8044e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:33.343462 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.344121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.348735 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1411/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:33 2022] DELETE /identity/v3/projects/102ead245137485986316da5be8044e0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:33.349756 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:33.360117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b3a29-f2af-4e9d-9bb6-947f547343d7 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:33.419036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:33.419719 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:33.420040 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:33.420429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] PATH_INFO: `/v3/users/612c8606406f465fa2601829fabbc8d1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:33.421776 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612c8606406f465fa2601829fabbc8d1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:33.423704 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:33.480209 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612c8606406f465fa2601829fabbc8d1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.495178 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612c8606406f465fa2601829fabbc8d1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.495885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612c8606406f465fa2601829fabbc8d1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.519304 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612c8606406f465fa2601829fabbc8d1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.520265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6eb7c722-18d3-4ad4-80b7-bf9d29536a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612c8606406f465fa2601829fabbc8d1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:33.531149 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:33.536535 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1425/2836] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:33 2022] DELETE /identity/v3/users/612c8606406f465fa2601829fabbc8d1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:33.844352 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:33.851024 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:33.881314 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f39df-9ff9-4d4f-b0c4-4407aff9d5d5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:33.920897 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:33.964713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:33.965429 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:33.969847 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:33.970144 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] PATH_INFO: `/v3/projects/5822975d15354f32a166d1e71f11c368` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:33.974140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5822975d15354f32a166d1e71f11c368)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:33.976192 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.035559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5822975d15354f32a166d1e71f11c368', 'request_id': 'req-ad2e91e4-4029-487d-97ce-275eb1e10843'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:34.045494 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5822975d15354f32a166d1e71f11c368', 'request_id': 'req-ad2e91e4-4029-487d-97ce-275eb1e10843'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:34.052834 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5822975d15354f32a166d1e71f11c368', 'request_id': 'req-ad2e91e4-4029-487d-97ce-275eb1e10843'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:34.065030 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] The token cache is being invalidate because project 5822975d15354f32a166d1e71f11c368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:34.065435 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:34.066770 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-ad2e91e4-4029-487d-97ce-275eb1e10843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:34.068674 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1412/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:33 2022] DELETE /identity/v3/projects/5822975d15354f32a166d1e71f11c368 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:34.073481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.073920 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.074815 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.106515 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:34.108563 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:34.201127 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1426/2838] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:34.209685 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.209971 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.210245 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.234007 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:34.235229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:34.243206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1413/2839] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:34.247598 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.258101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef313f0-6801-45cd-a1d1-e11b74f2e42d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.263338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.264036 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.264396 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.264745 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.265560 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:34.265947 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.267643 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.280742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1427/2840] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:34.285226 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.295316 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9660e-d8cf-40ea-9618-66b3568458b7 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.299982 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.300600 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.300883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.301154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.301851 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.303755 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.343251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1414/2841] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:34.343991 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.355542 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4310a-d98e-48dc-9375-963619dc9019 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.420864 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.421645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.421997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.422342 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.423085 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.425335 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.447525 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1428/2842] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:34.452418 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.462783 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6d2e-d775-4f75-a775-03f541454f8e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.468145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.468774 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.469059 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.469388 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.470088 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.471695 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.482326 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1415/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:34.486740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.497020 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab139-51d2-42ab-b66c-d474670f4785 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.501940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.502579 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.502867 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.503146 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.503850 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.505495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a050a-cd71-4c0f-9e7b-10bad7cd239b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.520519 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1429/2844] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:34.522298 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.534914 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5766a-9108-4355-83ec-937dda63c09c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.540287 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.541311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.541311 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.543826 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] PATH_INFO: `/v3/projects/994b116b758342518d40fb967ee611e1/users/cd11bf7dfba34e16a12d9be3d1e884c3/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.566507 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=994b116b758342518d40fb967ee611e1, user_id=cd11bf7dfba34e16a12d9be3d1e884c3, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.569174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.584859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1416/2845] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:34 2022] PUT /identity/v3/projects/994b116b758342518d40fb967ee611e1/users/cd11bf7dfba34e16a12d9be3d1e884c3/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:34.657027 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.657340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.657622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.688359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] MFA Rules not processed for user `cd11bf7dfba34e16a12d9be3d1e884c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:34.689602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:34.754627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:34.769597 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1430/2846] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:34.774154 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.845606 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfdca7-d02f-469e-98eb-3c8ff6e2cd5c admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.851497 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.852247 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.852531 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.852809 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.853532 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.855536 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:34.860621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:34.892747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1417/2847] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:34.896669 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:34.911429 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931723e-2b33-4f24-8663-eb53d445ebd1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:34.977450 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:34.978431 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:34.978772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:34.979059 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:34.979757 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:34.981723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.004926 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1431/2848] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:34 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:35.008995 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.022174 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0df684-70da-4a11-9a3e-4e62c30bdf9d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.027884 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.028523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.028840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.029119 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.030051 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.031682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.043625 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1418/2849] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:35.048622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.060616 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc2364-2a86-4932-b12a-d0ad66912c57 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.065333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.066012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.066302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.066720 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] PATH_INFO: `/v3/projects/7779b29e4cfe470baea69240da155c6b/users/735f91e31336469c9edd93bbba95278d/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.083562 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7779b29e4cfe470baea69240da155c6b, user_id=735f91e31336469c9edd93bbba95278d, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.086476 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.105415 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1432/2850] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:35 2022] PUT /identity/v3/projects/7779b29e4cfe470baea69240da155c6b/users/735f91e31336469c9edd93bbba95278d/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:35.108694 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.119209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b8a06-f01a-4aed-95f4-8de2933bb9e6 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.235294 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.235938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.236318 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.236570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.237722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.239092 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85a14-14d2-4cc4-ad55-8ef3e55ee259 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.250954 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1419/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:35.255481 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.268155 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4441-ca0b-4ed5-a4f2-4dc46f00ec10 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.273315 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.274014 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.274301 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.274718 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] PATH_INFO: `/v3/projects/7779b29e4cfe470baea69240da155c6b/users/735f91e31336469c9edd93bbba95278d/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.277747 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7779b29e4cfe470baea69240da155c6b, user_id=735f91e31336469c9edd93bbba95278d, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.280458 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.293319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1433/2852] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:35 2022] PUT /identity/v3/projects/7779b29e4cfe470baea69240da155c6b/users/735f91e31336469c9edd93bbba95278d/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:35.303525 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.303916 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.304676 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.351634 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] MFA Rules not processed for user `735f91e31336469c9edd93bbba95278d`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:35.352870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:35.429716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1420/2853] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:35.441552 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.443518 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:35.510679 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2180-41fc-4c13-ab4c-92f839e7117f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.514710 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.515340 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.515625 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.515902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.526118 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.527576 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.539095 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1434/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:35.616683 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:35.628049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80aec-4e92-4957-966b-f9f5e0fa8ede None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:35.638203 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:35.638854 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:35.639140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:35.639415 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:35.705703 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:35.710198 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:35.712410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55e4f4-f610-4cbe-a6c2-3f8026eae03e service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:35.727216 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1421/2855] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:36.020905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:36.077610 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:36.094847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273852aa-1c16-460e-a8cf-235a36640d7c service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:36.099665 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:36.100309 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:36.100590 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:36.100862 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] PATH_INFO: `/v3/users/cd11bf7dfba34e16a12d9be3d1e884c3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:36.102054 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd11bf7dfba34e16a12d9be3d1e884c3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:36.103972 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:36.158932 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd11bf7dfba34e16a12d9be3d1e884c3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.167341 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd11bf7dfba34e16a12d9be3d1e884c3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.168265 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd11bf7dfba34e16a12d9be3d1e884c3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.189621 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd11bf7dfba34e16a12d9be3d1e884c3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.190357 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd11bf7dfba34e16a12d9be3d1e884c3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.216891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1435/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:36 2022] DELETE /identity/v3/users/cd11bf7dfba34e16a12d9be3d1e884c3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:36.225310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:36.225310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:36.225310 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:36.255715 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:36.257132 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:36.343328 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1422/2857] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:36.359766 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:36.361356 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:36.425902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5166248-fe0b-4aca-a214-ebe7c090c96d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:36.429935 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:36.430660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:36.431319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:36.431319 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:36.442660 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:36.445109 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:36.456937 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1436/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:36.783377 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:36.785056 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:36.798178 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e3daf-7156-4880-95d3-5e1600480a2c None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:36.813933 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:36.814602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:36.814805 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:36.815076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] PATH_INFO: `/v3/projects/994b116b758342518d40fb967ee611e1` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:36.816665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994b116b758342518d40fb967ee611e1)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:36.819130 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:36.871764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994b116b758342518d40fb967ee611e1', 'request_id': 'req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.880558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994b116b758342518d40fb967ee611e1', 'request_id': 'req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.891162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994b116b758342518d40fb967ee611e1', 'request_id': 'req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.902073 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] The token cache is being invalidate because project 994b116b758342518d40fb967ee611e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:36.902360 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.904353 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:36.905955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1423/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:36 2022] DELETE /identity/v3/projects/994b116b758342518d40fb967ee611e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:36.910585 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:36.920498 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c347b-5d0a-4864-b4b6-f2901e82b128 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:36.979266 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:36.979905 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:36.980189 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:36.980469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] PATH_INFO: `/v3/users/735f91e31336469c9edd93bbba95278d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:36.981677 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735f91e31336469c9edd93bbba95278d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:36.983622 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:36.996806 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:37.032058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735f91e31336469c9edd93bbba95278d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.039128 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735f91e31336469c9edd93bbba95278d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.039813 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735f91e31336469c9edd93bbba95278d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.051827 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735f91e31336469c9edd93bbba95278d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.052490 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-240d1a96-029e-4c91-a7a9-077063d48724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735f91e31336469c9edd93bbba95278d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.065049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1437/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:36 2022] DELETE /identity/v3/users/735f91e31336469c9edd93bbba95278d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:37.336426 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.337988 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:37.351084 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7ac28-fcfa-489e-9e27-5ac6fec1dfe7 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.410972 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.411661 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.412010 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.412363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] PATH_INFO: `/v3/projects/7779b29e4cfe470baea69240da155c6b` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.413920 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7779b29e4cfe470baea69240da155c6b)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.415938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.442239 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:37.468831 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7779b29e4cfe470baea69240da155c6b', 'request_id': 'req-f9446df5-80fa-4462-bd6d-8d51a870c758'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.476145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7779b29e4cfe470baea69240da155c6b', 'request_id': 'req-f9446df5-80fa-4462-bd6d-8d51a870c758'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.483569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7779b29e4cfe470baea69240da155c6b', 'request_id': 'req-f9446df5-80fa-4462-bd6d-8d51a870c758'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.494385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] The token cache is being invalidate because project 7779b29e4cfe470baea69240da155c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:37.495143 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.495837 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-f9446df5-80fa-4462-bd6d-8d51a870c758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:37.498012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1424/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:37 2022] DELETE /identity/v3/projects/7779b29e4cfe470baea69240da155c6b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:37.503896 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.504268 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.504631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.525672 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:37.526983 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:37.593247 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1438/2862] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:37.602443 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.602730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.603011 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.623208 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:37.624511 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:37.632602 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1425/2863] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:37.636999 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.647365 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14db352-2a88-4ecd-bd25-155426d99221 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.652277 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.652900 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.653282 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.653540 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.654802 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:37.655117 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.656797 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.669395 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1439/2864] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 20:11:37.674682 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.683937 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990cf9-2b28-4b36-9882-971a97541d2e None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.689237 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.689896 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.690184 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.691555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.691555 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.693161 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.734076 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1426/2865] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:37 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:37.735322 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.747079 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8511ec-ba7a-4cf4-a5e5-77e60ca892b4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.809351 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.810523 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.810811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.811099 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.811759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.813715 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.838929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1440/2866] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:37 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:37.842881 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.854992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d3ee-31ba-4756-9b94-ccc3eb2a764d admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.859956 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.860629 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.860908 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.861179 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.861907 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.863522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.879265 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1427/2867] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:37.882982 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.895901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8b2e-4f03-49f8-942a-17aadb6d3155 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.901389 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.902107 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.902469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.903198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.903628 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.905529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55090cc0-0c8c-473d-8ca6-30f3c92be140 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.910056 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:37.924006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1441/2868] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 20:11:37.927883 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:37.939340 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa88d-e9f9-49c5-9f34-8509563581c5 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:37.944684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:37.945535 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.945688 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.946004 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] PATH_INFO: `/v3/projects/9325e8cf54924fc1a8add056a0c56c56/users/b246d29a1a77479886aa97fe7a098235/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:37.964996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9325e8cf54924fc1a8add056a0c56c56, user_id=b246d29a1a77479886aa97fe7a098235, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:37.967987 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:37.984495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1428/2869] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:37 2022] PUT /identity/v3/projects/9325e8cf54924fc1a8add056a0c56c56/users/b246d29a1a77479886aa97fe7a098235/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:37.995735 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:37.996025 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:37.996344 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:38.029225 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] MFA Rules not processed for user `b246d29a1a77479886aa97fe7a098235`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:38.030635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:38.140974 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1442/2870] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:38.149206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:38.151284 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:38.219095 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134eeb3-db43-41ca-80bf-af7e1683f542 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:38.222936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10705bb480e94b7484e5a3a4983a7cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:38.223716 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:38.223998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:38.224451 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:38.234492 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:38.235983 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cd9d1-dc7b-47ec-81e7-1a32dbc3ecd2 service cinder] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:38.246274 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1429/2871] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:41.354770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:41.471965 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200dee-4f72-4959-93ef-8f4b0775985f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:41.476485 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:41.477150 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:41.477467 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:41.477740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] PATH_INFO: `/v3/users/b246d29a1a77479886aa97fe7a098235` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:41.478897 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b246d29a1a77479886aa97fe7a098235)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:41.480799 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:41.525842 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b246d29a1a77479886aa97fe7a098235'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:41.533755 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b246d29a1a77479886aa97fe7a098235'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:41.534451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b246d29a1a77479886aa97fe7a098235'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:41.548603 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b246d29a1a77479886aa97fe7a098235'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:41.549294 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b246d29a1a77479886aa97fe7a098235'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:41.562979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1443/2872] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:11:41 2022] DELETE /identity/v3/users/b246d29a1a77479886aa97fe7a098235 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:41.567611 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:41.568079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:41.568201 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:41.590765 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:41.592559 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:41.636416 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:41.659823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1430/2873] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 20:11:41.670366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:41.671788 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:41.681902 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:41.746912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da585e88-b024-47f0-86da-7fe245874418 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:41.750663 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:41.751285 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:41.751566 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:41.751844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:41.761798 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:41.763781 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20144-b6ce-4696-b372-ab1c8c3f73ec service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:41.774184 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1444/2874] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:42.051049 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.052558 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:42.066337 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc730cb-3a1c-4244-b124-e5bb2ff36a2d None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.070936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.071577 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.071859 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.072134 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] PATH_INFO: `/v3/projects/9325e8cf54924fc1a8add056a0c56c56` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.073816 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9325e8cf54924fc1a8add056a0c56c56)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.076472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.124439 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9325e8cf54924fc1a8add056a0c56c56', 'request_id': 'req-c809bb90-cbad-4970-935d-77fe17c9a923'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:42.132466 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9325e8cf54924fc1a8add056a0c56c56', 'request_id': 'req-c809bb90-cbad-4970-935d-77fe17c9a923'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:42.139282 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9325e8cf54924fc1a8add056a0c56c56', 'request_id': 'req-c809bb90-cbad-4970-935d-77fe17c9a923'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:42.149924 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] The token cache is being invalidate because project 9325e8cf54924fc1a8add056a0c56c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:11:42.150212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:42.151103 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-c809bb90-cbad-4970-935d-77fe17c9a923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:11:42.152598 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1431/2875] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:11:42 2022] DELETE /identity/v3/projects/9325e8cf54924fc1a8add056a0c56c56 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:42.158666 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.158975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.159248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.178101 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:42.179289 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:42.239407 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1445/2876] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:42.247998 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.248285 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.248563 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.268312 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:42.269554 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:42.277710 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1432/2877] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:42.281895 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.302102 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7e880-7dd6-4c4b-b062-ce5b906ca96a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.307307 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.308012 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.308372 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.308716 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.309529 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 20:11:42.310411 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.312092 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.324606 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1446/2878] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 20:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 20:11:42.329712 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.339397 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b3a0-9791-4286-bab4-ec575a84ccc9 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.344475 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.345111 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.345436 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.345717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.346400 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.348392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.377301 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1433/2879] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:42 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:42.381511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.392517 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9845f3-f072-4f1f-adb1-1dc7d2e4dda7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.449455 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.450081 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.450930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.451248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.451930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.453872 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.474619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1447/2880] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:42 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:42.478713 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.489069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072b95-cb8e-4738-be4d-a27e81ec8fe2 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.493784 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.495368 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.495656 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.495938 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.496636 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.498799 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.508823 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1434/2881] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:42.512731 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.523221 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299d7a7-6cdf-4959-b11e-7cbbde77e7fd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.528121 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.528722 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.529002 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.529293 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.529995 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.531602 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23283fe-029e-4b6e-bac2-af0ba24fad01 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.541966 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1448/2882] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:42.546671 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.556376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a310-af88-457f-84f8-00250433b81e admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.561618 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.562270 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.562568 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.562822 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] PATH_INFO: `/v3/projects/e8d7e6101ff547f590c46e5eb1a1eddc/users/ce6a8da420c64f6ab8181dd31c71a0ac/roles/d4e2d689cd514e8c861f5736930af1d6` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.576947 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d7e6101ff547f590c46e5eb1a1eddc, user_id=ce6a8da420c64f6ab8181dd31c71a0ac, role_id=d4e2d689cd514e8c861f5736930af1d6)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.579628 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.592701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1435/2883] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:42 2022] PUT /identity/v3/projects/e8d7e6101ff547f590c46e5eb1a1eddc/users/ce6a8da420c64f6ab8181dd31c71a0ac/roles/d4e2d689cd514e8c861f5736930af1d6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:42.597649 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2257fa-490b-4dc0-a86e-f2fbcdf2f9f0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.597944 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2257fa-490b-4dc0-a86e-f2fbcdf2f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.598230 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2257fa-490b-4dc0-a86e-f2fbcdf2f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.617245 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2c2257fa-490b-4dc0-a86e-f2fbcdf2f9f0 None None] MFA Rules not processed for user `cad5bc1942444b43bdd85c7ebf430c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:42.618484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2c2257fa-490b-4dc0-a86e-f2fbcdf2f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:42.628029 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:42.678393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1449/2884] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:42.690043 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:42.691718 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:42.747003 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f0d4-c48a-487f-84db-a8ec72564904 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:42.751206 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:42.751817 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:42.752099 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:42.752376 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:42.761257 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:42.762717 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:42.772045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1436/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:46.901936 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:46.902500 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:46.902809 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:46.959624 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] MFA Rules not processed for user `ce6a8da420c64f6ab8181dd31c71a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:46.960955 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:47.056723 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1450/2886] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:47.061045 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.072931 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f82d1-3e36-4e2b-8d8b-71608132e37e service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.078930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.079641 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.079935 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.080234 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.081162 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.083392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.089186 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:47.130069 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1437/2887] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 20:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 20:11:47.131661 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.144879 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765d39-f403-4f13-b1f0-191123151a8b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.212856 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.213526 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.213811 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.214088 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.214770 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.217302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.241404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1451/2888] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 20:11:47 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 20:11:47.242583 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.252753 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513dd55-0009-4af3-8096-49ac5e6bb999 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.257233 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.257866 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.258145 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.258417 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.259098 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.260684 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.270913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1438/2889] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:47.274971 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.285988 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551de8-762d-425b-9d65-67ea129ff2be admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.290609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.291267 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.291551 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.291828 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] PATH_INFO: `/v3/projects/389e86f2eafc4acdb92c9ccbf195d470/users/76a0a5ccfde04aa0ba5fc70aa556728b/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.307623 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=389e86f2eafc4acdb92c9ccbf195d470, user_id=76a0a5ccfde04aa0ba5fc70aa556728b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.310349 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.323063 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1452/2890] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:47 2022] PUT /identity/v3/projects/389e86f2eafc4acdb92c9ccbf195d470/users/76a0a5ccfde04aa0ba5fc70aa556728b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 20:11:47.327478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.337580 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebaa5-a5d6-4f2e-9fc6-b4d31573211a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.395380 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.396012 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.396325 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.396605 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.397341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.398930 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.409638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1439/2891] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 20:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 20:11:47.414290 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:47.426250 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee0ba3-c788-44cd-ac77-81bce62edabc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:47.431030 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:47.431703 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:47.432050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:47.432339 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] PATH_INFO: `/v3/projects/389e86f2eafc4acdb92c9ccbf195d470/users/76a0a5ccfde04aa0ba5fc70aa556728b/roles/37946d08da58471c9678da91450dd183` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:47.434931 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389e86f2eafc4acdb92c9ccbf195d470, user_id=76a0a5ccfde04aa0ba5fc70aa556728b, role_id=37946d08da58471c9678da91450dd183)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:47.438061 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2671ca-96c6-4846-b7bc-a3d633b9b7d2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:47.443854 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:47.451223 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1453/2892] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 20:11:47 2022] PUT /identity/v3/projects/389e86f2eafc4acdb92c9ccbf195d470/users/76a0a5ccfde04aa0ba5fc70aa556728b/roles/37946d08da58471c9678da91450dd183 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:11:51.485101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:51.656087 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540f76a-f7e9-485c-b497-6b872690ad9a admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:51.778815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:51.779867 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:51.780365 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:51.780902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:51.783205 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:51.821973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:51.985592 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:51.987127 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:52.001679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1440/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:52.552305 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddbc3-fe82-4616-a9eb-69fd9d88172c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:52.552769 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddbc3-fe82-4616-a9eb-69fd9d88172c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:52.552892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddbc3-fe82-4616-a9eb-69fd9d88172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:52.585391 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-94eddbc3-fe82-4616-a9eb-69fd9d88172c None None] MFA Rules not processed for user `76a0a5ccfde04aa0ba5fc70aa556728b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:52.586943 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-94eddbc3-fe82-4616-a9eb-69fd9d88172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:52.691198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1454/2894] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:11:52.706493 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:11:52.708107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:52.896829 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396bb6d-cf65-49e1-9bb3-3a76bddb0426 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:11:52.904235 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:11:52.904968 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:52.905363 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:52.905722 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:52.985679 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:11:52.987760 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:11:52.995147 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=100 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:53.007251 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1441/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:11:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:11:54.264949 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:11:54.265619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:11:54.265619 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:11:54.300880 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] MFA Rules not processed for user `ce6a8da420c64f6ab8181dd31c71a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:11:54.303148 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:11:54.322795 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1455/2896] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 20:11:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:12:04.285513 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=38 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:12.980747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:12:12.982189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:12:13.073572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0584-aa9e-4a20-8b2a-39e2a27a5d79 service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:12:13.079271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:12:13.079910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:12:13.080194 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:12:13.080472 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:12:13.082271 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:12:13.094183 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:12:13.095751 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b936b5-73ae-4bfd-9f3b-21ffabd073fd service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:12:13.105513 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1442/2897] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:12:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:12:22.457997 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:12:22.477975 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6972b2-6818-45b8-849a-03e21de08244 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:12:22.481541 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:12:22.482709 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:12:22.482973 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:12:22.483248 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:12:22.492374 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:12:22.493823 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:12:22.505214 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1456/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:12:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:12:23.101407 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=41 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:32.500844 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:13:21.191637 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] REQUEST_METHOD: `POST` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:21.192094 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:21.192204 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:21.220767 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.auth.core [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] MFA Rules not processed for user `85d4f04027f54c20a5a89b029bbd21aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80313) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 20:13:21.221996 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:13:21.275152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1443/2899] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 20:13:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 20:13:21.316253 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:13:21.317775 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:13:21.385108 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3d79-9807-46fd-b235-8549cf74775c service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:13:21.390753 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44c1c7b81af41e5a016950b3aeb8589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:13:21.391316 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:21.391609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:21.391892 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:21.399929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:13:21.401841 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:13:21.410337 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1457/2900] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 20:13:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 20:13:27.691110 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:13:27.692902 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:13:27.791747 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa15f-125f-4478-8c1c-69978cd18877 None None] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:13:27.796343 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:13:27.797016 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:27.797327 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:27.797610 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] PATH_INFO: `/v3/users/5c29e332134c4727a3254d43dd3bb7c3` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:27.798787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c29e332134c4727a3254d43dd3bb7c3)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:13:27.800728 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:13:27.846150 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c29e332134c4727a3254d43dd3bb7c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:27.852840 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c29e332134c4727a3254d43dd3bb7c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:27.853520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c29e332134c4727a3254d43dd3bb7c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:27.854121 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c29e332134c4727a3254d43dd3bb7c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:27.864803 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:13:27.867519 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c29e332134c4727a3254d43dd3bb7c3'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:27.880910 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1444/2901] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:13:27 2022] DELETE /identity/v3/users/5c29e332134c4727a3254d43dd3bb7c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:13:28.061302 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:13:28.073183 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92b51-3d7b-46b6-9f49-25350a1daa7e service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:13:28.137653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:13:28.138296 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:28.138639 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:28.138963 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] PATH_INFO: `/v3/projects/df203a82310d4dcda03d096b8f13207a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:28.140840 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df203a82310d4dcda03d096b8f13207a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:13:28.142861 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:13:28.188859 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df203a82310d4dcda03d096b8f13207a', 'request_id': 'req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.195929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df203a82310d4dcda03d096b8f13207a', 'request_id': 'req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.202100 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df203a82310d4dcda03d096b8f13207a', 'request_id': 'req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.214635 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] The token cache is being invalidate because project df203a82310d4dcda03d096b8f13207a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:13:28.214930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.215627 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.217484 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1458/2902] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:13:28 2022] DELETE /identity/v3/projects/df203a82310d4dcda03d096b8f13207a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:13:28.221202 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:13:28.222643 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:13:28.236249 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db93e-0be7-4ece-89e6-57950e656433 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:13:28.294261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:13:28.294912 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:28.295196 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:28.295476 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] PATH_INFO: `/v3/users/7a96da5d9d864f2c85dab0ce32ae70a5` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:28.297189 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a96da5d9d864f2c85dab0ce32ae70a5)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:13:28.299149 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:13:28.349116 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a96da5d9d864f2c85dab0ce32ae70a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.355917 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a96da5d9d864f2c85dab0ce32ae70a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.356572 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a96da5d9d864f2c85dab0ce32ae70a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.357180 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a96da5d9d864f2c85dab0ce32ae70a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.371642 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a96da5d9d864f2c85dab0ce32ae70a5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.385523 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1445/2903] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:13:28 2022] DELETE /identity/v3/users/7a96da5d9d864f2c85dab0ce32ae70a5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:13:28.560191 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:13:28.561748 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:13:28.574692 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b80f8-3246-452c-9f5a-e5dcd5913e4e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:13:28.591759 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:13:28.633705 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:13:28.634359 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:13:28.634699 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:13:28.634981 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] PATH_INFO: `/v3/projects/cb02f44fae4e4652912f06e965a5b5dc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:13:28.636139 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb02f44fae4e4652912f06e965a5b5dc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:13:28.638206 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:13:28.684693 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb02f44fae4e4652912f06e965a5b5dc', 'request_id': 'req-0c38ddee-b885-441b-b867-e079d16e89f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.692577 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb02f44fae4e4652912f06e965a5b5dc', 'request_id': 'req-0c38ddee-b885-441b-b867-e079d16e89f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.698482 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb02f44fae4e4652912f06e965a5b5dc', 'request_id': 'req-0c38ddee-b885-441b-b867-e079d16e89f9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.709767 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] The token cache is being invalidate because project cb02f44fae4e4652912f06e965a5b5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:13:28.710058 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.710969 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:13:28.712464 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1459/2904] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:13:28 2022] DELETE /identity/v3/projects/cb02f44fae4e4652912f06e965a5b5dc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:13:38.381849 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:DELETE=12,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:13:38.706631 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:18.946533 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:18.948038 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:19.027990 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0477-eb7c-472a-83f3-2c30043da360 admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:19.078844 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:19.079478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:19.079766 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:19.080040 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:19.081945 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:19.151724 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:19.153197 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:19.164410 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1446/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:14:20.344819 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:20.346454 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:20.359694 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ddee-b885-441b-b867-e079d16e89f9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:20.363286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:20.363901 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:20.364186 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:20.364463 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:20.366808 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:20.379885 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:20.381338 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:20.392495 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1460/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:14:29.159463 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=79 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:30.387393 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:32.524623 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:32.534020 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79b21-0743-4104-bad5-af3117ac956a service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:32.537621 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:32.538229 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:32.538508 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:32.538785 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:32.540501 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:32.550540 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:32.551964 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:32.559885 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1447/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:14:32.674572 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:32.683366 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebba0-2646-47c8-bb0a-c48d0d15bd83 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:32.688477 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:32.689170 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:32.689554 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:32.690048 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:32.692392 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:32.703530 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:32.704979 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:32.713440 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1461/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:14:32.815467 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:32.816893 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:32.827777 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeac99d-a8ba-4bab-9479-cec419f9fe0b service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:32.831522 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:32.832222 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:32.832570 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:32.832913 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:32.834759 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:32.848745 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:32.850209 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:32.863394 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1448/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:14:32.923994 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:14:32.925475 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:32.993978 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f1ae7-c08c-457d-9986-dd3181cf87e9 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:14:32.999497 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:14:33.000113 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:14:33.000399 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:14:33.000676 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:14:33.002451 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:14:33.014179 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:14:33.015771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:14:33.025744 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1462/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 20:14:42.858730 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=12 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:43.021354 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=38 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:00.151870 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:00.161306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f5c9-5b20-4c25-86a4-7f2db2ef5965 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:00.166214 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9a68a43b80458caf2e622129508c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:00.167107 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:00.167392 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:00.167668 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:00.171944 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:00.182152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:00.183590 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:00.191702 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1449/2911] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:15:10.188101 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=6 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:47.582599 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:47.584940 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:47.602553 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d76e70-aa15-4ffd-95cf-e0a4f8f99a79 service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:47.609163 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:47.609912 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:47.610198 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:47.610473 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:47.612768 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:47.633654 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:47.635286 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:47.648803 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1463/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:15:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:15:50.667152 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:50.688569 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723d50-ccc2-49d3-b133-ad820fe6dc07 service neutron] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:50.695499 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be490d99a6d94f5ead55b8d35019ec9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:50.696283 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:50.696687 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:50.697140 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:50.699787 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:50.714047 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:50.715820 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:50.727548 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1450/2913] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:15:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:15:55.418707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:55.434511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f1a90-7c7b-4d9d-93dc-cc34d4457f34 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:55.439742 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:55.440384 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:55.440681 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:55.440952 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:55.442891 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:55.456469 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:55.458273 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:55.470331 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1464/2914] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:15:58.621973 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:58.638412 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeae380-bcdd-443b-bc3e-1e122c8e296a service nova] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:58.644520 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:58.645946 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] REQUEST_METHOD: `GET` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:58.646449 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:58.647079 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:58.649458 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:58.667955 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:58.670021 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:58.701196 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:58.703333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:58.713261 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1451/2915] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:15:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:15:58.796814 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b805734-fbb6-43d4-96a5-c4be8bbf5b63 service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:58.801410 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:58.802049 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:58.802334 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:58.802611 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] PATH_INFO: `/v3/users/ce6a8da420c64f6ab8181dd31c71a0ac` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:58.803771 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6a8da420c64f6ab8181dd31c71a0ac)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:58.805706 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:58.851653 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6a8da420c64f6ab8181dd31c71a0ac'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:58.859006 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6a8da420c64f6ab8181dd31c71a0ac'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:58.859929 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6a8da420c64f6ab8181dd31c71a0ac'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:58.872740 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6a8da420c64f6ab8181dd31c71a0ac'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:58.873447 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6a8da420c64f6ab8181dd31c71a0ac'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:58.885761 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1465/2916] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:15:58 2022] DELETE /identity/v3/users/ce6a8da420c64f6ab8181dd31c71a0ac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:15:59.062341 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:59.072899 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8b92-6ef4-45a8-9f96-6de1c4e389c2 service placement] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:59.129336 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:59.130042 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:59.130355 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:59.130638 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] PATH_INFO: `/v3/projects/e8d7e6101ff547f590c46e5eb1a1eddc` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:59.131845 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d7e6101ff547f590c46e5eb1a1eddc)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:59.133815 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:59.180358 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d7e6101ff547f590c46e5eb1a1eddc', 'request_id': 'req-6777490d-84fd-4e98-9640-8d51cb5cd33f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.187175 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d7e6101ff547f590c46e5eb1a1eddc', 'request_id': 'req-6777490d-84fd-4e98-9640-8d51cb5cd33f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.193495 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d7e6101ff547f590c46e5eb1a1eddc', 'request_id': 'req-6777490d-84fd-4e98-9640-8d51cb5cd33f'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.204240 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] The token cache is being invalidate because project e8d7e6101ff547f590c46e5eb1a1eddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:15:59.204530 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.205173 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.206701 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1452/2917] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:15:59 2022] DELETE /identity/v3/projects/e8d7e6101ff547f590c46e5eb1a1eddc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:15:59.210772 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:59.212239 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:59.225847 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a9e4e-599f-4c25-9a39-9daa17ee76e6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:59.274791 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:59.286849 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:59.287511 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:59.287800 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:59.288084 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] PATH_INFO: `/v3/users/76a0a5ccfde04aa0ba5fc70aa556728b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:59.289418 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a0a5ccfde04aa0ba5fc70aa556728b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:59.291271 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:59.338578 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a0a5ccfde04aa0ba5fc70aa556728b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.345404 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a0a5ccfde04aa0ba5fc70aa556728b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.346021 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a0a5ccfde04aa0ba5fc70aa556728b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.358050 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a0a5ccfde04aa0ba5fc70aa556728b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.358702 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a0a5ccfde04aa0ba5fc70aa556728b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.370824 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1466/2918] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 20:15:59 2022] DELETE /identity/v3/users/76a0a5ccfde04aa0ba5fc70aa556728b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:15:59.547478 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Authenticating user token {{(pid=80313) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:15:59.549019 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.fernet_utils [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80313) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:15:59.563427 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777490d-84fd-4e98-9640-8d51cb5cd33f admin admin] Validating token access rules against request {{(pid=80313) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:15:59.627658 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cad5bc1942444b43bdd85c7ebf430c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b3dbe2c1eb04d9797ed50b9b1752bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80313) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:15:59.628306 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:15:59.628487 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:15:59.628764 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] PATH_INFO: `/v3/projects/389e86f2eafc4acdb92c9ccbf195d470` {{(pid=80313) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:15:59.629919 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389e86f2eafc4acdb92c9ccbf195d470)` {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:15:59.631827 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] RBAC: Authorization granted {{(pid=80313) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:15:59.637915 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:59.679385 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389e86f2eafc4acdb92c9ccbf195d470', 'request_id': 'req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.686723 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389e86f2eafc4acdb92c9ccbf195d470', 'request_id': 'req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.693936 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389e86f2eafc4acdb92c9ccbf195d470', 'request_id': 'req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5'} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.704700 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] The token cache is being invalidate because project 389e86f2eafc4acdb92c9ccbf195d470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80313) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 20:15:59.704992 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.705665 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG keystone.notifications [None req-a30f9c8f-0f5e-4461-b7f7-6450968f81c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80313) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 20:15:59.707212 dv-cinder-851449-1-smb devstack@keystone.service[80313]: [pid: 80313|app: 0|req: 1453/2919] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 20:15:59 2022] DELETE /identity/v3/projects/389e86f2eafc4acdb92c9ccbf195d470 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 20:16:09.367333 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:09.701224 dv-cinder-851449-1-smb devstack@keystone.service[80313]: DEBUG dbcounter [-] [80313] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:06.436204 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 20:18:06.437673 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:18:06.507353 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7ef9-7072-45f5-8ed1-a21f90a2db1c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 20:18:06.565707 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845ce3ae6fd44a66b9fbe5a9c12e7eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f7c0a70ad94b019fd063c947ad7486', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 20:18:06.566332 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 20:18:06.566645 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 20:18:06.566930 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 20:18:06.568690 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 20:18:06.579832 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 20:18:06.581370 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3af80-fde5-4d9d-aede-28e4def5b5f9 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 20:18:06.592609 dv-cinder-851449-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1467/2920] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 20:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 20:18:16.588297 dv-cinder-851449-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=58 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}